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Abstract 


The  goal  of  this  research  was  to  develop  a  computational  method  for  modeling  automatic  image 
processing  system  performance.  Like  the  Minimum  Resolvable  Temperature  (MRT)  measure  in 
common  use  for  man-in-the-loop  imaging  systems,  this  new  method  should  have  the  following 
characteristics: 

(i)  It  is  easy  to  compute. 

(ii)  Results  based  on  system  performance  with  a  synthesized  pattern,  but  extendable  to  be 
independent  of  the  target  pattern. 

(iii)  Gives  performance  results  as  a  function  of  the  sensor  design  parameters. 

In  this  research  we  have  developed  a  measure,  which  we  call  the  Maximum  Resolvable  Polygon 
(MRP),  which  estimates  the  degree  of  shape  distortion  introduced  by  an  imaging  system.  The 
MRP  relies  on  a  computer  simulation  of  the  imaging  system.  While  such  a  computer  simulation 
requires  more  extensive  computer  power  than  the  computation  of  an  analytical  formula  like  the 
MRT,  the  MRP  may  still  be  considered  relatively  easy  to  compute.  All  software  simulations  and 
experiments  reported  here  were  performed  on  a  personal  computer. 

A  new  test  pattern  set  has  been  proposed  to  replace  the  bar  pattern  which  is  used  to  analyze  the 
performance  of  man-in-the-loop  systems.  Target-like  test  patterns  rely  on  the  use  of  regular 
polygons  and  are  parameterized  by  the  number  of  sides  in  the  polygons.  Clutter-like  objects  are 
also  derived  from  this  test  pattern  set. 

A  theoretical  analysis  of  the  MRP  indicates  that  it  estimates  the  target  shape  conditions  at  which  a 
target  recognition  system  will  produce  a  50%  error  rate.  Simulation  experiments  have  compared 
the  performance  which  the  MRP  measure  predicts  that  an  automatic  target  recognition  system 
would  have  with  the  performance  of  the  human  visual  pattern  recognition  system.  These 
experiments  indicate  that  the  MRP  can  be  used  as  a  reliable  measure  of  the  relative  performance 
ability  of  various  imaging  systems.  Although  performance  results  are  not  derived  analytically,  the 
simulation  analyses  do  produce  empirical  relationships  between  performance  and  sensor  system 
design  parameters. 

The  primary  application  of  this  research  will  be  to  assist  in  the  design  and  development  of  new 
sensor  systems.  The  basic  performance  modeling  technique  developed  here  can  be  used  to 
perform  sensor  system  trade-off  studies  on  resolution  versus  sensitivity,  detector  shape,  and 
sampling  array  geometry.  Extensions  may  be  made  to  other  system  design  parameters. 
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1 .  Abstract 


The  goal  of  this  research  was  to  develop  a  computational  method  for  modeling  automatic  image 
processing  system  performance.  Like  the  Minimum  Resolvable  Temperature  (MRT)  measure  in 
common  use  for  man-in-the-loop  imaging  systems,  this  new  method  should  have  the  following 
characteristics: 

(i)  It  is  easy  to  compute. 

(ii)  Results  based  on  system  performance  with  a  synthesized  pattern,  but  extendable  to  be 
independent  of  the  target  pattern. 

(iii)  Gives  performance  results  as  a  function  of  the  sensor  design  parameters. 

In  this  research  we  have  developed  a  measure,  which  we  call  the  Maximum  Resolvable  Polygon 
(MRP),  which  estimates  the  degree  of  shape  distortion  introduced  by  an  imaging  system.  The 
MRP  relies  on  a  computer  simulation  of  the  imaging  system.  While  such  a  computer  simulation 
requires  more  extensive  computer  power  than  the  computation  of  an  analytical  formula  like  the 
MRT,  the  MRP  may  still  be  considered  relatively  easy  to  compute.  All  software  simulations  and 
experiments  reported  here  were  performed  on  a  personal  computer. 

A  new  test  pattern  set  has  been  proposed  to  replace  the  bar  pattern  which  is  used  to  analyze  the 
performance  of  man-in-the-loop  systems.  Target-like  test  patterns  rely  on  the  use  of  regular 
polygons  and  are  parameterized  by  the  number  of  sides  in  the  polygons.  Clutter-like  objects  are 
also  derived  from  this  test  pattern  set 

A  theoretical  analysis  of  the  MRP  indicates  that  it  estimates  the  target  shape  conditions  at  which  a 
target  recognition  system  will  produce  a  50%  error  rate.  Simulation  experiments  have  compared 
the  performance  which  the  MRP  measure  predicts  that  an  automatic  target  recognition  system 
would  have  with  the  performance  of  the  human  visual  pattern  recognition  system.  These 
experiments  indicate  that  the  MRP  can  be  used  as  a  reliable  measure  of  the  relative  performance 
ability  of  various  imaging  systems.  Although  performance  results  are  not  derived  analytically,  the 
simulation  analyses  do  produce  empirical  relationships  between  performance  and  sensor  system 
design  parameters. 

The  primary  application  of  this  research  will  be  to  assist  in  the  design  and  development  of  new 
sensor  systems.  The  basic  performance  modeling  technique  developed  here  can  be  used  to 
perform  sensor  system  trade-off  studies  on  resolution  versus  sensitivity,  detector  shape,  and 
sampling  anay  geometry.  Extensions  may  be  made  to  other  system  design  parameters. 
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2.  Introduction 


Imaging  sensor  systems  have  been  used  primarily  in  man-in-the-loop  systems  where  a  human 
operator  must  view  the  image  created  by  the  sensor  and  make  decisions  based  upon  the  image.  As 
a  result,  sensor  system  parameters  have  been  optimized  for  human  visual  detection  and  recognition 
capability.  However,  as  Automatic  Target  Recognition  (ATR)  becomes  more  widespread,  sensor 
design  specifications  must  take  into  consideration  the  requirements  of  the  ATR  algorithms  to 
achieve  optimal  performance.  In  order  to  perform  engineering  trade-offs  and  evaluation  of 
competitive  sensor  designs,  models  are  required  which  predict  algorithm  performance  as  a  function 
of  the  sensor  system  parameters.  Such  performance  models  also  allow  engineers  to  determine  the 
limiting  performance  of  a  sensor  system  due  to  phenomenological  variations.  For  example,  even  if 
a  detector  of  infinite  resolution  and  sensitivity  could  be  devised,  atmospheric  turbulence  and 
temperature  fluctuations  will  limit  the  ability  of  the  system  to  recognize  distant  targets.  Knowledge 
of  such  limiting  performance  allows  the  system  designer  to  place  practical  bounds  on  the  sensor 
parameters  and  avoid  needless  over-specification  (and  higher  cost). 

Although  the  affects  of  sensor  parameters  on  human  recognition  performance  have  been  studied 
extensively,  work  done  to  relate  sensor  parameters  to  ATR  performance  is  still  in  its  infancy.  For 
example,  a  30  Hz  field  rate  c;  interlaced  video  was  settled  upon  for  man-in-the-loop  systems 
because  the  integration  time  associated  with  human  vision  dictates  that  this  is  nearly  the  minimum 
frame  rate  to  avoid  annoying  flicker.  However,  an  ATR  system  would  not  be  bothered  by  flicker. 
There  are  other  considerations  which  would  determine  the  optimum  frame  rate  for  ATR  systems, 
including  the  trade-offs  between  blurring  due  to  motion  in  the  scene  or  of  the  camera  and  noise 
reduction  due  to  longer  detector  integration  time. 

System  performance  analysis  is  the  study  of  how  information  is  degraded  through  a  system.  The 
classical  system  performance  analysis  criterion  for  man-in-the-loop  image  processing  systems  has 
been  the  Night  Vision  Laboratory  Static  Performance  Model.1  This  model  utilizes  an  analytical 
formulation  of  information  degradation  based  on  effects  of  the  system  on  the  frequency 
components  in  the  image  data.  Since  it  is  a  frequency  domain  effects  model,  it  is  primarily  useful 
for  analysis  of  the  linear-shift  invariant  components  of  an  imaging  system,  such  as  the  optics  and 
electronics  at  the  front  end.  The  model  gives  performance  results  in  terms  of  the  Minimum 
Resolvable  Temperature  Difference  (MRT).  The  MRT  has  the  following  significant  features: 

(i)  It  is  easy  to  compute. 

(ii)  Its  results  are  based  on  system  performance  with  a  synthesized  pattern  (a  bar 
pattern),  but  they  are  extended  through  empirical  analysis  to  be  independent  of  the 
target  pattern. 

(iii)  It  gives  performance  results  as  a  function  of  the  sensor  design  parameters. 

In  man-in-the-loop  systems,  all  information  processing  is  performed  by  the  human,  who  is 
modeled  as  a  linear  filter  matched  to  a  signal  of  the  desired  frequency.  Modem  imaging  systems 
contain  several  more  components  which  may  not  be  modeled  as  linear  shift  invariant  components. 
For  example,  staring  focal  plane  arrays  have  two  dimensional  sampling  inherent  in  the  architecture 
of  the  system  (Sampling  is  linear  but  not  shift  invariant,  hence  it  cannot  be  represented  as  a 
convolution  or  as  multiplication  in  the  frequency  domain.).  Also,  in  the  case  of  an  ATR  image 


1  J.  Ratches,  et  al,  "Night  Vision  Static  Performance  Model  for  Thermal  Viewing  Systems,  US  Army  Night 
Vision  Laboratory  Technical  Report  Number  ECOM-7043,  April  1975. 
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processing  system  there  is  another  major  subsystem  components  to  consider,  the  algorithm 
subsystem,  which  may  be  highly  nonlinear.  For  this  reason,  alternatives  to  frequency-based 
performance  analyses  are  being  considered. 

The  principal  impediment  to  progress  in  the  development  of  models  of  ATR  system  performance  is 
the  lack  of  a  measure  of  ATR  system  performance  having  the  same  characteristics  as  MRT.  The 
problem  is  that  any  imaging  system  has  several  components  which  contribute  to  the  degradation  of 
the  information  contained  in  the  image  data.  This  information  degradation  introduced  at  various 
stages  in  the  system  are  naturally  represented  in  different  forms:  pixel  intensity  variations  (optical 
MTF  and  noise),  shape  variations  (segmentation  errors),  variations  in  equivalence  classes  of  the 
computed  features  (insufficient  feature  set),  and  decision  error  probability  (system  output).  In 
order  to  have  a  systematic  performance  model,  these  various  forms  of  information  degradation 
must  be  related  to  a  single  measure. 

Historically,  researchers  have  used  the  natural  representation  of  information  degradation  at  the 
output  of  the  ATR  system,  namely  decision  error  probability,  as  the  measure  of  effectiveness  of  the 
entire  ATR  system.  The  difficulty  with  this  approach  is  that  there  are  a  wide  variety  of  ATR 
algorithms  which  are  developed  more  or  less  heuristically,  involving  a  sequence  of  many  steps. 
The  nonlinearity  and  procedural  nature  of  many  algorithms  make  a  rigorous  end-to-end  probability 
analysis  intractable.  Thus  there  are  basically  two  ways  to  proceed  with  system  performance 
analysis  if  decision  error  probability  is  chosen  as  the  measure:  Monte  Carlo  simulations,  or 
information  theoretic  methods  (i.e.  mathematically  defined  information)  with  approximations. 

End-to-end  Monte  Carlo  simulation  appears  to  be  the  prevailing  technique  used  to  evaluate  image 
processing  system  performance  .  There  are  several  shortcomings  with  this  approach.  It  is  difficult 
to  extrapolate  the  results  on  a  fixed  target  set  to  other  target  types.  The  entire  simulation  must  be 
run  again  if  a  new  sensor  is  used  since  there  is  no  way  of  relating  the  simulation  results  directly  to 
the  parameters  of  the  sensor  system.  Finally,  end-to-end  simulations  do  not  provide  insight  into 
the  characteristics  of  the  image  data  or  the  sensor  which  led  to  the  success  or  failure  of  the  test. 

There  has  also  been  some  research  into  the  use  of  mathematical-information  theoretic  methods  to 
find  theoretical  bounds  on  decision  error  probability.  These  methods  seek  to  avoid  performing 
Monte  Carlo  simulations  on  a  large  number  of  images  by  performing  complicated  computations  on 
the  mathematical-information  content  of  the  image  data  rather  than  on  the  image  data  itself.  Such 
methods  rely  on  complicated  transformations  of  the  image  data  to  determine  the  mathematical- 
information  content  of  an  image.  Furthermore,  since  algorithms  are  defined  to  operate  on  the 
image  data,  this  method  requires  that  the  algorithms  be  re-described  in  terms  of  their  effects  on  the 
mathematical-information  in  the  image.  This  step  requires  such  extensive  simplifying  assumptions 
that  one  wonders  whether  one  is  actually  modeling  the  performance  of  any  real  algorithm.  Thus 
the  use  of  mathematical-information  theoretic  methods  tends  quickly  to  become  mathematically 
intractable  and  non- intuitive. 

In  the  research  reported  on  here,  we  have  taken  the  view  of  image  processing  system  performance 
modeling  that  accurate  models  of  the  imaging  system  and  actual  algorithms  should  be  used 
whenever  possible.  Usually  this  means  using  computer  software  descriptions  of  both  the  sensor 
and  the  algorithms.  It  is  undesirable  to  describe  the  effect  of  some  processing  step  on  the 
mathematical-information  theoretic  content  of  an  image  when  the  algorithm  is  actually  applied  to  the 
image  data.  However,  it  is  equally  undesirable  to  have  to  perform  an  end-to-end  Monte  Carlo 
simulation  each  time  a  parameter  in  the  sensor  is  changed.  In  order  to  address  this  dilemma. 


f  Unless  otherwise  indicated,  we  use  the  term  "information’’  in  the  ordinary  sense  of  human  communication,  not  in 
the  mathematical  sense  of  Shannon's  Information  Theory. 
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innovative  performance  modeling  techniques  must  be  considered.  Thus  we  have  investigated  an 
approach  which  is  neither  a  completely  abstract  analytical  model  of  the  system  performance  nor  a 
full  Monte  Carlo  simulation. 

While  previous  attempts  to  define  a  performance  model  have  concentrated  on  relating  all  the  system 
distortions  to  the  measure  of  distortion  which  is  used  at  the  output  of  the  entire  system,  i.e. 
decision  error  probability,  in  this  research  we  have  investigated  the  possibility  of  relating  all  these 
distortions  types  to  one  of  the  other  natural  representations:  Object  Shape.  Choosing  shape 
distortion  as  a  measure  of  performance  would  force  imaging  systems  to  concentrate  on  retaining 
shape  fidelity  for  Automatic  Target  Recognition  systems  in  the  same  wav  that  current  imaging 
systems  are  forced  to  image  bar  patterns  accurately  in  order  to  obtain  a  good  MRT  score. 

The  objective  of  this  research  was  as  follows: 

Objective:  Develop  a  computational  method  for  modeling  automatic  image  processing  system 

performance.  Like  the  MRT  measure  for  man-in-the-loop  systems,  this  method 
should  have  the  following  characteristics: 

(i)  Easy  to  compute. 

(ii)  Results  based  on  system  performance  with  a  synthesized  pattern,  but 
extendable  to  be  independent  of  the  target  pattern. 

(iii)  Gives  performance  results  as  a  function  of  the  sensor  design  parameters. 

In  addressing  this  objective,  we  have  concentrated  on  image  processing  systems  which  use  a  single 
frame  of  image  data  from  a  single  monochromatic  sensor  to  Detect,  Classify,  Recognize,  or 
Identify  a  single  target  within  the  sensor  field  of  view. 

The  results  of  this  research  are  summarized  below: 

i)  We  developed  an  imaging  system  performance  analysis  method  based  on  measuring 
how  each  component  of  an  image  processing  system  distorts  the  shape  of  a  target  or 
clutter  object. 

ii)  We  related  shape  distortion  to  probability  of  error. 

iii)  We  developed  computer  software  to  implement  the  computation  of  the  shape  distortion 
effects  in  an  imaging  system.  This  computer  software  uses  existing  computer  models 
for  defining  system  components,  whenever  they  are  available,  with  as  little 
modification  as  possible. 

iv)  We  developed  a  parametric  set  of  test  patterns  which  is  similar  to  real  target  and  clutter 
patterns  so  that  performance  results  may  be  achieved  by  analyzing  only  a  small  set  of 
data. 

v)  We  used  our  new  approach  in  two  comparisons  of  imaging  sensors:  (i)  rectangular 
arrays  vs  hexagonal  arrays  of  detector  elements,  and  (ii)  varying  sensor  signal  to  noise 
ratios. 
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3.  Shape  Distortion  as  a  Measure  of  Imaging  System  Performance 
3.1.  Analyzing  imaging  System  Performance 

As  mentioned  above,  system  performance  analysis  is  the  study  of  how  information  is  degraded 
through  a  system.  In  an  ATR  system  there  are  two  major  subsystem  components  to  consider:  The 
sensor  subsystem  and  the  algorithm  subsystem.  In  order  to  obtain  a  consistent  measure  of  imaging 
system  performance,  the  inter-related  effects  of  information  degradation  introduced  by  all 
components  of  the  system  must  be  understood  and  considered.  There  are  two  principal  sources  of 
image  degradation  in  the  imaging  sensor  itself:  resolution  degradation,  which  is  usually  modeled 
as  deterministic  and  signal  dependent,  and  additive  noise  which  is  usually  modeled  as  random  and 
signal  independent  (at  least  to  a  reasonable  approximation).  After  the  image  is  formed,  the 
algorithm  subsystem  extracts  information  from  the  image.  These  algorithms  can  generally  be 
decomposed  into  four  components:  preprocessing,  segmentation,  transform  (feature)  computation, 
and  feature  matching  (i.e.  pattern  recognition). 

Each  component  of  an  imaging  system  generally  has  a  computer  model  or  algorithm  description 
which  depends  on  certain  design  parameters.  In  fact  in  many  cases,  a  system  component  may  be 
highly  nonlinear  or  may  be  described  only  in  terms  of  mathematical  or  computer  software 
descriptions  (e.g.  think  of  some  complex  scheme  of  thinning  the  edges  found  after  edge  detection). 
This  presents  severe  problems  for  a  totally  analytical  approach  to  system  performance  analysis. 

In  light  of  these  comments,  we  have  decided  to  study  how  information  is  degraded  through  a 
system  which  is  described  in  terms  of  such  models  and  codes  with  as  little  modification  as  possible 
to  the  mathematical-algorithmic  descriptions  of  the  system.  Therefore,  we  have  chosen  to  utilize  a 
computer  simulation  of  the  imaging  system  components.  Figure  1  shows  the  nature  of  the 
simulation.  The  upper  path  is  the  simulation  of  the  system  components.  Each  of  the  simulated 
components  operates  on  a  high  resolution  digital  representation  of  the  test  pattern.  The  output  of 
each  system  component  is  passed  to  the  next  simulated  system  component  as  well  as  to  a  distortion 
computation  block.  By  comparing  the  distortions  after  each  system  component,  the  information 
loss  through  the  system  can  be  monitored. 


Image  Data 


Figure  1.  Block  Diagram  of  the  System  Simulation  and  Shape  Distortion  Computation 

The  information  degradation  introduced  at  various  stages  in  the  system  are  naturally  represented  in 
different  forms:  pixel  intensity  variations,  shape  variations,  variations  in  equivalence  classes  of  the 
computed  features,  and  decision  error.  In  order  to  have  a  systematic  performance  model,  these 
various  forms  of  information  degradation  must  be  related  to  a  single  measure.  Previous  attempts  to 
define  system  performance  models  have  concentrated  on  relating  all  the  distortions  to  the  measure 
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of  distortion  which  is  used  at  the  output  of  the  entire  system,  i.e.  decision  error.  The  object  of  this 
research  has  been  to  investigate  the  possibility  of  relating  all  these  distortions  types  to  one  of  the 
other  natural  representations:  Object  Shape.  Several  issues  must  be  addressed  in  determining  how 
to  use  the  object  shape  distortion  as  a  measure  of  imaging  system  performance: 

i)  We  must  determine  a  set  of  test  patterns  which  is  similar  to  real  target  and  clutter 
patterns  so  that  performance  results  may  be  achieved  by  analyzing  only  a  small  set  of 
data. 

ii)  We  must  adopt  a  shape  representation  that: 

a)  Allows  us  to  determine  how  each  of  the  system  components  affects  object 
shape,  given  some  accurate  model  of  the  imaging  system  components  in  the  form  of 
mathematical  or  computer  software  descriptions;  and 

b)  Permits  an  efficient  method  of  computing  the  distortion  in  the  object  shape  at  the 
output  of  each  of  the  system  components. 

iii)  We  must  relate  object  shape  distortion  to  the  probability  that  the  imaging  system  makes 
an  error. 

These  issues  are  addressed  in  the  subsequent  sections. 

3.2.  The  Test  Pattern  Set  and  Definition  of  the  Imaging  System  Tasks 

One  of  the  goals  of  the  research  was  to  obtain  performance  results  which  are  based  on  the  use  of 
synthesized  patterns  but  which  are  extendable  to  be  independent  of  the  target  pattern.  Synthetic 
imagery  is  most  useful  for  experimentation  since  it  allows  more  accurate  control  of  the 
computations  than  is  possible  with  real  targets.  The  NVL  Static  Performance  Model  uses  a  pattern 
of  bars,  since  it  relates  information  content  of  an  image  to  its  frequency  content.  Since  we  are 
exploring  a  different  approach  which  relies  on  shape  distortion,  we  require  a  set  of  test  patterns 
with  more  shape  definition.  In  the  tactical  use  of  Army  ATR  systems  there  are  a  large  variety  of 
targets  and  clutter.  What  is  sought  for  performance  modeling  is  a  set  of  patterns  with 
characteristics  which  make  them  similar,  in  some  sense,  to  real  targets  and  real  clutter,  but  which 
are  easier  to  manipulate  than  real  target  and  clutter  signatures.  We  have  developed  a  parametrically 
defined  pattern  set  which  we  believe  can  be  used  as  the  basis  for  target  and  clutter  independent 
performance  analysis. 

3.2.1.  Target  Shaaes 

An  observation  about  targets  motivates  our  choice  of  target  shapes.  Targets  generally  are  man 
made  objects  which  tend  to  have  regular  shapes  (in  the  sense  of  being  orderly,  or  neat).  The  most 
regular  of  all  shapes  is  the  Circle,  which  we  use  as  the  baseline  target  shape.  Many  tactical  targets 
can  be  geometrically  described  as  the  union  of  a  collection  of  polygons.  Therefore,  additional 
target  shapes  are  generated  by  regular  polygons:  isosceles  triangle,  square,  pentagon,  etc. 

Each  of  these  shapes  is  convex,  and  their  boundaries  can  be  defined  in  polar  coordinates  by  a 
radius  function  p(0).  We  use  a  polar  coordinate  definition  of  these  shapes  because  it  provides  a 
compact  way  to  define  them  parametrically,  and  because  rotated  versions  of  the  shapes  can  be 
generated  very  easily. 

3.2.1. 1.  Circle 

The  formula  for  the  boundary  of  the  circular  target  is  given  by 
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p(0,°°)  =  r  , 

r  is  the  constant  radius  of  the  circle. 

3.2. 1.2.  Regular  Polygon 

The  formula  for  the  regular  polygon  with  n  sides  in  polar  coordinates  is  given  as  follows  (see  the 
Appendix  for  the  derivation  of  this  formula): 

p(0,n)  =  rn/cos(0  -  2rt/2n  -  k  2rt/n),  for  k  27r/n  <  0  <  (k+l)27t/n,  k=0,l,...,n-l 

where  rn  is  the  minimum  radius  of  the  n-sided  regular  polygon,  n  is  the  number  of  sides  in  the 
polygon,  and  k  is  an  index  for  which  side  is  bemg  drawn,  0  corresponding  to  the  first  side,  n-1 
corresponding  to  the  last  side.  This  formula  can  be  simplified  slightly  by  using  modulo  arithmetic: 

p(0,n)  =  rn/cos(  (0  mod  (Inin) )  -  2n/2n  ) 

The  expression  x  mod  y  for  x  and  y  being  real  numbers  is  construed  to  mean  the  same  thing  as  for 
integer  values  of  x  and  y,  namely 

x  mod  y  =  x  -  Greatest  Integer[x/y], 

3.2.2.  Clutter  Shanes 

Clutter  shapes  tend  to  be  highly  varied.  With  open  terrain  in  the  background,  one  would  expect 
clutter  objects  to  be  fairly  irregular  in  shape,  with  many  sharp  comers.  Some  geographical 
features,  however,  may  look  quite  smooth,  such  as  the  boundary  of  a  water  body  or  road  or  the 
sides  of  buildings.  These  latter  clutter  shapes  have  some  characteristics  similar  to  target  shapes. 

In  light  of  this  discussion  we  derive  clutter  shapes  from  the  polygonal  shapes  by  randomly 
modifying  the  boundary  of  the  polygons  as  follows: 

Pclutter(M)  =  p(0,n)  +  U(0,a,6) 

where  U  is  a  random  function  with  the  two  parameters:  a  =  the  magnitude  of  the  random  function, 
and  b  which  relates  to  the  bandwidth  of  the  random  function.  A  low  bandwidth  random  function 
tends  to  create  more  regular  looking  clutter  than  is  created  by  using  high  bandwidth  random 
functions.  The  random  function  is  added  to  the  target  shapes  in  order  to  obtain  clutter  shapes 
which  are  approximately  the  same  size  as  the  targets.  The  random  function  U  is  generated 
according  to  the  following  formulation 

U(0k,a,6)  =  (l-£>)*U(0k-  i ,a,b)  +  6*ranu(k) 

where  ranu(k)  is  a  random  number  generator  giving  independent,  uniformly  distributed  random 
values  in  the  range  [*.5,.5],  and  0k  are  samples  of  the  angle  parameter  0.  The  closer  b  is  to  unity, 
the  wider  the  bandwidth  of  the  resulting  function  U  becomes. 

Figure  2  shows  images  of  several  polygonal  targets  and  clutter  shapes.  Notice  that  it  is  easy  to 
generate  rotated  versions  of  the  targets  and  clutter  shapes  by  adding  a  constant  rotation  angle  to  0  in 
the  above  formulas.  The  ability  to  create  objects  with  varying  rotations  is  useful  because  some 
imaging  systems  may  have  "preferred  orientations"  in  which  they  give  better  results  than  in  other 
orientations. 
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Figure  2.  Polygonal  Target  and  Clutter  Shapes:  a)  4-sided  polygon,  b)Rotated  4-sided  polygon, 
c)  5-sided  polygon,  d)  High  bandwidth  clutter  object  created  with  a  =  50,b  =  .8,  e)  Low 
bandwidth  clutter  object  created  with  a  =  400,  b  =  .02. 
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We  define  the  tasks  of  the  imaging  system  within  the  context  of  these  target  and  clutter  shapes  to  be 
as  follows 


i)  Detection:  Distinguish  between  the  polygonal  shapes  and  one  of  the  clutter  shapes 
derived  from  the  circle. 

ii)  Recognition:  Distinguish  between  one  of  the  polygonal  shapes  and  the  circle  shape. 

iii)  Identification:  Distinguish  between  two  different  polygonal  shapes,  or  equivalently, 
count  the  number  of  sides  in  a  polygonal  shape. 

The  single  parameter,  the  number  of  sides  in  a  polygonal  shape,  characterizes  the  difficulty  of  the 
target  set  for  recognition  or  identification.  For  example,  increasing  the  number  of  sides  in  the 
polygonal  target  increases  the  difficulty  of  the  system  to  distinguish  the  polygon  from  the  circle. 
The  clutter  parameters  a  and  b  define  the  difficulty  of  the  Detection  task.  The  closer  the  amplitude  a 
and  bandwidth  b  are  to  zero,  the  more  the  clutter  object  will  look  like  the  circle  target. 

3.3.  Shape  Representation  and  Shape  Distortion  Computation 

The  original  shapes  are  defined  in  terms  of  polar  coordinates  for  convenience  in  creating  them  for 
the  simulation.  This  may  not  be  the  most  ideal  coordinate  system  to  use  during  the  analysis  of  the 
system  effects  on  the  shapes.  There  are  several  desirable  characteristics  to  be  considered  in 
choosing  an  object  shape  representation  scheme: 

i)  The  representation  scheme  must  be  able  to  unambiguously  define  the  desired  patterns. 

ii)  The  shape  representation  must  be  compatible  with  the  computer  software  simulation  of 
the  system  components. 

iii)  In  general,  the  accuracy  of  imaging  system  simulations  increases  as  the  resolution  of 
the  digital  test  patterns  increases.  Since  high  resolution  digital  test  patterns  usually 
require  large  amounts  of  memory,  the  shape  representation  scheme  should  be  memory 
efficient. 

iv)  The  desired  shape  distortion  measures  must  be  computable  from  the  shape 
representation. 

We  now  discuss  two  representation  schemes  with  respect  to  the  characteristics  stated  above.  Then 
we  present  our  reasons  for  choosing  the  representation  we  did. 

3.3.1.  Shape  Representation  in  Rectangular  Coordinates 

The  most  obvious  and  straightforward  method  of  representing  image  shapes  is  simply  to  provide  a 
digital  mask  of  the  test  patterns  themselves  in  standard  two-dimensional  rectangular  coordinates. 
Such  an  image  presentation  has  the  form 

m  n  -  1 1  if  Go*  6  tar§et 

f(lJ>  "  1 0  else 

where  i  and  j  are  the  indices  in  a  rectangular  lattice.  The  images  of  Figure  2  are  examples  of  this 
type  of  representation. 
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Although  the  polygonal  test  patterns  are  each  binary  valued  images  which  represent  the  shapes  of 
the  test  pattern,  the  output  of  any  component  in  the  imaging  system  may  in  fact  take  on  other  values 
besides  0  and  1.  Furthermore,  shape  distortion  analysis  concentrates  on  how  the  imaging  system 
distorts  the  boundaries  of  the  targets.  The  values  of  pixels  in  the  interior  of  the  target  are  not 
relevant  to  shape  distortion  analysis.  Therefore  whenever  the  shape  distortion  effects  of  a 
particular  component  of  the  imaging  system  are  to  be  analyzed,  the  image  data  is  First  segmented, 
i.e.  the  target  pixels  are  labeled  with  value  1  and  the  background  pixels  are  labeled  with  value  0. 
Virtually  all  ATR  algorithms  contain  some  form  of  segmentation  step.  Ideally,  the  segmentation 
algorithm  which  is  used  in  the  shape  distortion  analysis  would  be  the  same  as  the  one  which  is 
used  by  the  ATR  system  itself.  However,  it  is  also  valuable  to  be  able  to  analyze  an  imaging 
system  in  a  way  which  is  more  or  less  independent  of  the  details  of  specific  ATR  algorithms.  Thus 
some  baseline  segmentation  algorithm  must  be  used  by  the  Shape  Distortion  Analyzer.  The 
specific  segmentation  algorithm  used  in  our  computation  of  shape  distortion  is  discussed  later. 

The  rectangular  coordinates  shape  representation  scheme  clearly  enjoys  the  characteristics  (i)  and 
(ii)  of  a  desirable  shape  representation  scheme.  Since  there  is  no  coding  of  the  image  data,  this 
representation  of  the  test  patterns  is  compatible  with  the  standard  existing  computer  software 
simulations  of  the  system  components,  and  it  can  obviously  be  used  to  represent  any  desired 
shape. 

This  representation  scheme  also  submits  to  easy  computation  of  at  least  one  useful  distortion 
measure: 


Arect(n»I)  - 


J  lsn  *  sn ( I ) I 

JA 


where  sn(I)  is  the  segmented  result  of  passing  an  n-sided  regular  polygon  image  through  the 
imager  I.  It  is  shown  in  the  next  section  that  this  distortion  measure  can  be  related  to  error 
probability  to  get  an  overall  system  performance  measure. 

The  big  disadvantage  of  this  representation  of  shape  is  that  it  is  extremely  memory  inefficient  The 
memory  requirements  for  representing  a  target  shape  in  an  image  of  dimensions  NxN  pixels  is 
proportional  to  N2. 

3.3.2. _ Shane  Representation  in  Polar  Coordinates 

A  complete  and  accurate  description  of  the  shape  of  an  object  can  also  be  given  in  terms  of  the 
location  of  each  border  point,  which  is  the  second  method  we  considered  for  representing  object 
shapes.  The  edge  location  may  be  coded  in  several  ways.  For  example  the  x-y  coordinates  of  each 
border  point  may  be  given  in  rectangular  coordinates  or  the  position  of  just  one  point  on  the  border 
may  be  given  together  with  the  chain  code  to  each  subsequent  point  on  the  border.  A  polar 
coordinate  representation  seems  particularly  useful.  Consider  for  example  a  high  resolution  image 
of  a  circular  target  The  shape  of  the  target  can  be  compactly  represented  by  the  radius  function 


«w)-{i  iLf +j2),/2sp(9) 


where  p(0)  =  radius  of  the  target  at  angle  0,  which  is  the  distance  from  the  center  of  the  target  to  the 
edge  as  a  function  of  angle  (where  "center"  is  suitably  defined,  e.g.  as  the  centroid).  Thus  the 
shape  is  completely  described  by  the  polar  coordinates  function  p(9).  This  description  of  the 
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circular  target  results  in  a  one  dimensional  waveform  of  constant  value.  Figure  3  shows  the  polar 
coordinate  representation  of  the  circular  shape  pattern  and  some  polygonal  shape  patterns. 

This  representation  scheme  enjoys  characteristics  (iii)  and  (iv)  stated  above  for  a  desirable  shape 
representation  scheme.  In  fact  the  primary  advantage  to  this  polar  coordinate  coding  of  the  shape 
edges  is  that  it  is  very  memory  efficient,  since  it  ignores  the  interior  points  of  an  object  shape  and 
concentrates  on  points  near  the  edges.  The  memory  requirements  for  representing  a  target  shape  in 
an  image  of  dimensions  NxN  pixels  is  proportional  only  to  N  (in  fact  the  number  of  edge  samples 

2tiIV 

required  is  approximately  (piXek/edge  sample)  ^  Note  also  frora  Fi§ure  3  lhat  the  Polar 

coordinates  representation  for  the  test  targets  is  periodic.  Thus  in  fact  the  effects  of  the  imaging 
system  on  only  one  period  of  the  radius  function  would  need  to  be  considered  in  order  to  get 
results  over  the  entire  shape. 

This  representation  scheme  would  also  permit  a  potentially  rich  collection  of  shape  distortion 
measures  to  be  considered.  A  radius  distortion  function  can  be  computed  as  the  absolute  value  of 
the  difference  between  the  radius  function  of  the  original  and  the  distorted  waveforms. 

d(9,n,I)  =  lp(6,n)  -  p(e,n,I)l 

where  p(0,n,I)  denotes  the  radius  function  of  the  n-sided  polygon  after  distortion  by  the  system  I. 
One  obvious  scalar  measure  of  distortion  is  obtained  by  simply  integrating  d  with  respect  to  0: 


Apolar(niI)  - 


1 


d(0,n,I) 


This  measure  is  in  fact  proportional  to  Arect(n,I)  as  given  above.  Other  simple  and  potentially 
useful  summary  distortion  parameters  are  also  available  from  d(0,n,I).  For  example  the  distortion 
function  d(0,n,I)  may  be  treated  as  if  it  were  a  random  function  of  0  and  statistics  may  be  collected 
on  it,  such  as  the  histogram  of  the  values  of  d(0,n,I),  or  the  maximum,  mean  and  standard 
deviation  of  its  values,  or  its  roughness.  Alternatively  one  may  compute  the  magnitude  of  the 
Fourier  transform  of  d(0,n,I)  (as  a  function  of  0)  and  use  the  low  frequency  portion  of  the  power 
spectrum  (since  it  is  obvious  that  large  values  in  the  low  frequency  indicate  large  distortions). 
While  it  is  not  clear  that  any  of  these  measures  are  any  better  at  predicting  the  performance  of  the 
imaging  system  than  Arect  would  be,  at  least  this  representation  scheme  does  permit  them  to  be 
computed  veiy  easily  from  d(0,n,I). 

Unfortunately,  there  are  two  severe  disadvantages  to  the  use  of  this  polar  coordinates  shape 
representation  scheme.  First,  it  can  only  be  used  to  represent  convex  shapes,  since  the  radius 
function  p(0)  is  unambiguously  defined  only  for  convex  shapes.  This  to  not  too  much  of  a 
limitation  for  the  original  target  and  clutter  shapes,  since  each  of  them  is  a  convex  shape  which  has 
been  defined  through  such  a  polar  coordinates  mapping.  However,  when  sampling  and  noise  are 
considered,  non-convex  shapes  can  result,  as  will  be  shown  later. 
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The  most  serious  serious  disadvantage  to  the  use  of  the  poiar  coordinate  representation  is  the  fact 
that  it  is  not  directly  compatible  with  standard  existing  computer  software  simulations  of  the  system 
components.  This  means  that  existing  mathematical  and  algorithmic  descriptions  of  imaging 
system  components  would  have  to  be  modified  to  accommodate  the  system  simulation  shown  in 
Figure  1.  Most  models  for  system  components  assume  a  rectangular  coordinate  system 
representation  for  the  input  image  data.  Thus  if  we  were  to  replace  the  standard  representation  of  a 
circular  image  with  the  polar  representation  given  by  the  simple  radius  function  p(0)  =  const.,  we 
would  have  to  determine  out  how  to  simulate  the  optics,  the  sampler  and  all  the  other  components 
of  the  imaging  system  in  terms  of  processing  this  one-dimensional  radius  function.  This  is  fairly 
difficult  for  the  filtering  and  sampling  components  of  an  imaging  system  system,  but  it  would  be 
even  more  difficult  for  some  exotic  algorithmic  components  of  the  system. 

3.3.3.  The  Shape  Representation  Choice 

Although  it  was  our  original  intention  to  pursue  the  use  of  the  polar  coordinate  representation  of 
shapes  in  this  research,  we  have  settieed  on  using  the  rectangular  coordinates  shape  representation 
as  given  above  for  the  following  reasons: 

i)  The  rectangular  coordinates  shape  representation  is  the  most  compatible  with  existing 
software  models  of  the  imaging  system.  By  using  the  rectangular  coordinates  shape 
representation  we  were  able  to  spend  more  time  on  analyzing  the  effectiveness  of  using 
shape  distortion  as  a  performance  measure  and  less  time  on  modifying  existing  models 
of  imaging  systems. 

ii)  The  rectangular  coordinates  shape  representation  is  more  readily  understandable  when  it 
is  displayed. 

iii)  Although  rectangular  coordinates  shape  representation  requires  more  computer  memory 
to  store  and  process  high  resolution  test  patterns  than  the  polar  coordinates 
representation,  this  characteristic  seems  to  be  the  least  important  of  the  four  criteria  of  a 
good  shape  representation  scheme  which  were  listed  at  the  beginning  of  section  3.3. 

iv)  As  we  show  below,  Arect  can  be  directly  related  to  probability  of  recognition  error, 
which  would  be  substantially  more  difficult  for  any  of  the  exotic  distortion  measures 
mentioned  above  which  may  easily  be  computed  from  d(0,n,I).  Furthermore,  there  is 
no  clear  evidence  that  any  of  those  other  distortion  measures  are  any  better  at  predicting 
the  performance  of  the  imaging  system  than  Arect  would  be. 

Now  that  we  have  settled  on  a  shape  representation  scheme,  we  show  in  the  next  section  how  the 
shape  distortion  computation  can  be  related  to  imaging  system  performance  in  terms  of  error 
probability. 

3.4.  Shane  Distortion  Computation  and  Its  Relationship  to  System  Error 

Probability 

While  probability  of  error  is  usually  considered  the  most  appropriate  measure  of  system 
performance  for  the  tasks  defined  in  the  previous  section,  as  we  have  stated,  probability  of  error  is 
often  difficult  to  compute.  What  is  required  is  a  summary  distortion  measure  which  is  a  scalar 
quantity,  which  can  be  functionally  related  to  the  probability  that  an  ATR  system  will  successfully 
perform  one  of  the  three  tasks  detection,  recognition,  or  identification.  In  this  respect  the  summary 
distortion  measure  is  to  be  like  the  MRT  (Minimum  Resolvable  Temperature)  which  characterizes 
man-in-the-loop  IR  imaging  systems. 
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A  bound  on  system  error  probability  is  actually  very  easy  to  obtain  once  we  are  given  the  target  set. 
This  bound  is  related  to  the  concept  of  the  Matched  Filter.  When  the  target  shape  is  known 
exactly,  the  Matched  Filter  is  the  best  possible  linear  pattern  matching  technique.  Thus  the  error 
incurred  by  using  Matched  Filters  to  perform  pattern  recognition  can  be  used  to  provide  a  lower 
bound  on  the  error  which  would  be  incurred  by  use  of  any  linear  pattern  matching  technique.  The 
Matched  Filter  only  provides  a  bound  on  system  performance  because  in  most  ATR  applications, 
the  exact  target  shape  is  n£i  known  beforehand.  In  fact  the  reason  for  most  of  the  feature 
transformations  found  in  ATR  schemes  (chain  code,  invariant  moments,  etc.)  is  that  there  are  target 
shape  uncertainties  due  to  such  unknown  transformations  as  rotation  and  size  scaling  of  the  target. 
By  providing  a  link  between  shape  distortion  analysis  and  the  Matched  Filter,  we  expect  to  obtain  a 
bound  on  performance  which  applies  to  most  statistical  pattern  matching  techniques  that  use  feature 
transformations  of  the  image. 

We  stressed  the  word  "linear"  above  because  many  features  and  pattern  recognition  techniques 
now  under  consideration  by  artificial  intelligence  researchers  are  far  from  being  linear.  For 
example,  when  trying  to  distinguish  between  the  typewritten  letters  "t"  and  "f,"  one  would  most 
likely  look  for  the  presence  of  a  rightward  curvature  at  the  top  or  the  bottom  of  the  character  instead 
of  performing  a  Matched  Filter  over  the  entire  character.  Similarly  one  might  look  for  wheels  or  a 
gun  to  distinguish  between  a  truck  and  a  tank.  While  a  bound  on  system  performance  based  on  the 
linear  Matched  Filter  may  appear  to  be  useless  to  these  "  AI"  techniques,  we  note  that  the  process  of 
looking  for  portions  of  a  target  is  just  a  collection  of  subproblems  of  looking  for  a  lot  of  smaller 
targets.  Therefore  we  would  apply  the  concept  of  the  Matched  Filter  bound  to  each  of  these 
subproblems.  How  these  performance  bounds  on  each  subproblem  accumulate  to  form  a 
performance  bound  on  the  overall  target  recognition  task  depends  on  how  the  ATR  algorithm 
combines  the  results  from  each  of  the  subproblems.  It  is  unlikely  that  any  generally  applicable 
technique  exists  to  find  the  overall  bound  in  every  such  algorithm  specific  example  and  we  have 
not  investigated  this  aspect  of  the  problem  in  this  phase  of  the  research. 


In  target  detection,  "error"  usually  means  the  sum  of  two  types  of  errors:  Miss,  and  False  Alarm. 
This  assumes  that  there  is  one  class  of  objects  called  "Target"  and  everything  else  is  "Not  Target," 
i.e.  "Clutter."  In  target  recognition  there  are  two  are  more  specific  classes  of  objects,  say  Target  A 
and  Target  B,  and  samples  must  be  assigned  to  one  of  them.  In  this  case  "error"  means  the  sum  of 
all  occurrences  where  either  an  A  sample  is  assigned  to  class  B,  or  a  B  sample  is  assigned  to  class 
A. 

Decisions  in  either  Detection  or  Recognition  are  often  reduced  to  the  problem  of  thresholding  a 
single  functional  value  which  is  computed  from  the  image  data.  From  classical  detection  and 
estimation  theory,  this  functional  is  usually  given  by  the  output  of  a  Matched  Filter.  If  there  is  any 
randomness  in  the  received  data,  then  the  functional  value  is  also  random.  The  thresholding 
value(s)  can  be  set  for  either  the  Detection  or  Recognition  task  by  considering  the  probability 
density  function  (pdf)  of  the  functional  value  under  the  various  conditions. 

The  pdf  of  the  Matched  Filter  output  for  the  target  often  has  some  spread  around  a  central  value. 
Similarly,  the  pdf  for  the  "Clutter"  class  has  some  spread.  Although  some  output  values  may  be 
more  or  less  likely  than  others  in  reality,  the  class  "Clutter"  is  so  broad  and  ill-defined,  that  one 
seldom  knows  anything  about  its  probability  density  function.  This  demonstrates  a  fundamental 
difference  between  "Target"  and  "Clutter."  The  pdf  spread  for  Target  is  due  entirely  to  the 
randomness  in  the  receiver,  not  due  to  any  uncertainty  in  the  definition  of  the  class.  That  is,  in  the 
absence  of  receiver  randomness  (noise),  the  Matched  Filter  output  for  the  Target  would  be  a 
constant  In  fact  the  pdf  of  the  Matched  Filter  output  when  noise  is  present  is  simply  the  pdf  of  the 
receiver  noise,  shifted  so  that  its  mean  corresponds  to  this  value  of  what  the  Matched  Filter  output 
would  be  without  the  receiver  noise.  The  spread  of  the  pdf  for  Clutter  is  due  mostly  to  uncertainty 
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in  the  definition  of  the  class.  Even  if  there  were  no  noise  in  the  receiver,  there  would  still  be  a 
spread  (and  probably  a  broad  one)  for  the  Clutter  pdf.  In  either  task,  Detection  or  Recognition,  the 
definition  of  the  error  probability  uses  the  pdfs  of  receiver  noise.  Furthermore,  in  the  Detection 
task,  a  pdf  must  be  defined  for  the  Clutter  class. 

The  mathematics  for  computing  error  probability  for  recognition  of  targets  in  additive  white 
Gaussian  noise  is  well  worked  out.2  We  summarize  those  results.  Suppose  the  objective  is  to 
decide  between  two  targets,  sa  and  sb,  one  of  which  is  present  in  an  image  with  additive  white 
Gaussian  noise.  Define 


Ea 


Sa 


2 


P  =  J  sa  sb 

A 

o2  =  variance  of  the  additive  noise 


cfi 


(sa  -  Sb)2 


erfc*(x) 


oo 


/* 

J 


^=-  exp(-x2/2) 


Then  the  error  probability  is  given  by 

Perror  =  erfc  *{d) 

It  is  important  to  notice  that  the  computation  for  probability  of  error  depends  on  the  signals 
involved. 

3.4.2.  The  Maximum  Resolvable  Polygon  for  Noise-Free  Imaeinn 

We  start  with  the  quantity  cfi  and  use  it  to  compute  a  summary  measure  of  system  performance 
based  on  the  polygonal  and  circular  target  set. 

It  makes  sense  to  separate  the  distortion  effects  of  diffraction  and  sampling  fu»m  'he  effects  of 
noise  in  any  imaging  system.  The  deterministic  distortion  effects  should  be  easier  to  handle 
analytically  and  for  some  applications,  they  may  be  the  limiting  effects.  Thus  we  defer  the 
discussion  of  how  to  handle  noisy  imaging  systems. 


2  H.L.  van  Trees,  Detection,  Estimation,  and  Modulation  Theory,  Part  1,  John  Wiley  and  Sons,  1968,  pp  254ff. 
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Consider  the  Recognition  problem,  i.e.  the  situation  where  the  targets  to  be  distinguished  are  fixed 
and  deterministically  defined.  Since  there  is  no  randomness  in  the  receiver  and  the  signals  are 
deterministic,  a  natural  question  then  is:  What  does  "probability  of  error"  mean  where  no 
randomness  exists?  Considering  the  above  discussion  on  probability  of  error,  the  quantity  d 
would  be  infinite  in  a  noise  free  situation  since  the  noise  variance  a2  would  be  considered  0  in  such 
a  case.  Inserting  this  value  for  d  in  the  formula  for  Perror  then  gives  0.  This  is  clearly  not  helpful. 

Thus  we  take  a  different  view  of  the  situation.  For  a  receiver  in  which  the  noise  variance  a2  is 
fixed,  the  quantity  of  interest  is 


The  last  simplification  of  the  integrand  is  because  the  signals  we  are  using  are  binary  valued.  The 

quantity  dft,  which  is  equal  to  eft  a2,  defines  how  the  targets  are  "separated"  in  signal  space.  The 
larger  this  quantity  is,  the  better  one  will  be  able  to  distinguish  target  sa  from  target  Sb- 

Obviously  dft  depends  on  the  characteristics  of  the  two  signals  in  question.  We  introduce  the 
following  notation.  Let  do2(n,<»)  to  denote  the  value  of  deft  when  sa  =  n-sided  regular  polygonal 
test  pattern  and  Sb  =  Circle  test  pattern.  Similarly  let  do2(n,I)  denote  the  value  of  dft  when  sa  =  n- 
sided  regular  polygonal  test  pattern  and  Sb  =  the  image  of  the  same  -sided  regular  polygonal  test 
pattern  as  obtained  through  imager  I.  Notice  that  do2(n,I)  is  simply  a  different  name  for  the  shape 
distortion  measure  Arec^nJ)  which  was  defined  previously. 

Suppose  that  for  two  pairs  of  undegraded  targets  we  get  the  following  values  (the  units  are 
immaterial) 

do2(6,°°)=  10000  for  sa  =  Hexagon  test  pattern,  Sb=  Circle  test  pattern 

dft{A,oo)  =  20000  for  sa  =  Square  test  pattern.  Circle,  Sb  =  Circle  test  pattern 

This  says  of  course  that  it  should  be  easier  to  distinguish  between  the  Square  and  the  Circle  than  to 
distinguish  between  the  Hexagon  and  Circle.  Now  suppose  that  we  pass  the  Hexagon  and  Square 
test  patterns  through  some  portion  of  the  imaging  system  A,  then  segment  the  resulting  image  and 
compute 

d<ft(6,A)  =  10000  for  sa  =  Hexagon  ,  sb  =  Hexagon  distorted  by  system  A 

do2(4,A)  =  10000  for  sa  =  Square  ,  Sb  =  Square  distorted  by  system  A 

do2(6,A)  is  roughly  the  same  value  as  the  distance  between  the  Hexagon  and  the  Circle.  If  we 
know  we  are  supposed  to  be  looking  for  a  Hexagon,  we  may  try  to  set  the  threshold  in  the 
Matched  Filter  processor  low  enough  that  the  distorted  Hexagon  pattern  would  pass  the  threshold 
and  be  called  a  Hexagon  by  the  Matched  Filter  processor.  But  using  this  threshold,  the  Matched 
Filter  processor  would  also  declare  that  an  ideal  Circle  is  a  Hexagon.  Thus  such  a  system  would 
generate  an  error  if  its  task  is  to  distinguish  between  a  hexagon  and  a  circle.  However,  since 
do2(4,A)  <  dft{ 4,oo)  it  is  possible  to  set  a  threshold  to  be  able  to  distinguish  between  the  distorted 
Square  and  the  ideal  Circle  targets.  Thus  such  a  system  would  n£j  generate  an  error  if  its  task  is  to 
distinguish  between  a  Square  and  a  Circle. 
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Now  say  another  imaging  system  B  gives  do2(6,B)  =  20000  and  do2(4,A)  =  20000.  In  this  case  it 
is  not  possible  to  set  a  threshold  so  that  either  the  Hexagon  or  the  Square  could  be  distinguished 
from  the  Circle.  In  this  comparison,  one  would  be  able  to  say  qualitatively  that  system  A  is  better 
than  system  B  since  do2(n,A)  <  tfo2(n,B)  for  the  test  patterns  being  considered,  i.e.  for  the  values 
of  n  considered. 

The  above  discussion  leads  to  the  following  method  of  characterizing  the  performance  of  an 
imaging  system. 

•  Compute  the  Normalized  Distortion  Measure 


5W(n,I) 


tjp2(n,I) 

do2(n,°o) 


-  s  n  *  (1)1 


S  OC  I 


for  Soo  =  ideal  Circle,  sn  =  ideal  n-sided  regular  polygon  for  n=3,...,  and  sn*(I)  = 
segmented  result  of  passing  an  n-sided  regular  polygon  shape  through  the  subject  imager 
(or  portion  of  the  imager). 

•  Find  the  value  of  n  such  that  the  Normalized  Distortion  Measure  5Vf(n,I)  ~  1. 

•  Quote  this  value  of  n  as  the  Maximum  Resolvable  Polygon  (MRP). 

Figure  4  describes  the  computation  of  the  Normalized  Distortion  Measure  fti(n,I). 


Segment  Image  Data 


Test  Pattern 


Circle  Pattern 


Test  Pattern 


Figure  4.  Computation  of  Normalized  Distortion  Measure  M(n,I) 

The  ratio  tMfn,I)  can  be  plotted  as  a  function  of  n.  Better  imaging  systems  will  have  lower  values 
of  !W(n,I).  Alternatively  stated,  better  imagers  have  larger  values  of  the  MRP.  They  permit  a 
Matched  Filter  to  solve  harder  recognition  problems  because  they  introduce  less  shape  distortion 
into  the  image  data. 

However,  the  MRP  is  more  than  just  a  qualitative  measure  of  system  performance.  Like  the  MRT, 
the  MRP  defines  the  target  situation  (in  the  MRP  case:  the  target  shapes)  for  which  the  "probability 
of  error"  is  barely  equal  to  one-half.  If  the  imaging  system  is  presented  with  a  regular  polygon 
having  n  <  MRP  sides,  then  £f(n,I)  <  1  which  means  that  there  exists  a  threshold  which  would 
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allow  the  Matched  Filter  processor  to  always  distinguish  between  the  polygon  and  the  Circle 
shapes.  Presenting  a  polygon  with  n  >  MRP  sides  means  tvf(n,l)  >  1  and  no  threshold  could  be 
found  which  would  give  better  results  than  guessing. 

3.5.  Noisv  Imagers  and  Segmentation 

Although  the  MRP  criterion  was  developed  above  on  the  basis  of  noise-free  imaging,  it  may  also 
be  used  in  cases  where  noise  is  present  in  the  system.  In  the  case  of  noisy  imagers,  the  additive 
noise  source  may  be  viewed  as  a  separate  component  of  the  imaging  system  which  introduces 
some  additional  distortion  on  the  test  pattern. 

There  are  two  issues  which  must  be  resolved  when  admitting  noise  as  one  of  the  imaging  system 
components.  First  is  the  issue  of  how  to  segment  the  image  data.  Recall  that  in  order  to  compute 
<io2(n,I),  the  image  data  must  be  segmented  so  that  the  targets  pixels  have  value  1  and  the 
background  pixels  have  value  0.  Segmentation  in  the  absence  of  noise  is  easy  since  a  simple 
threshold  operator  can  separate  background  and  target  pixels  in  such  a  case.  The  situation  is  much 
more  complicated  when  noise  is  present.  Figure  5a  shows  a  5-sided  polygonal  target  which  has 
been  imaged  through  a  noisy  sensor.  Figure  5b  shows  the  results  of  simple  thresholding.  The 
target  area  has  holes  in  it  and  the  background  contains  isolated  pixels  which  have  been  classified  as 
target  pixels.  This  simple  result  is  not  appropriate  for  shape  distortion  analysis.  Most  reasonably 
good  ATR  systems  would  be  able  to  segment  the  target  from  the  background  better  than  this. 
What  is  needed  is  a  baseline  segmentation  algorithm  that  is  equivalent  to  thresholding  when  no 
noise  is  present,  but  which  clearly  isolates  the  target  pixels  when  noise  is  present.  We  have  settled 
on  a  two  step  segmentation  procedure: 

•  Threshold  the  image  at  a  value  midway  between  the  original  target  and  background 
intensity  values. 

•  Fix-up  the  resultint  binarized  image  by: 

(i)  Filling  in  the  holes  in  the  target  area 

(ii)  Discarding  the  incorrectly  classified  background  pixels 

The  following  is  a  description  of  our  first  attempt  at  an  algorithm  to  perform  these  two  "fix-up" 
tasks: 


Algorithm  A  to  "Fix-Up"  the  Thresholded  Image 

(a)  Detect  edge  pixels  in  the  thresholded  image. 

(b)  Determine  the  size  of  each  region  which  is  enclosed  by  the  edge  pixels. 

(c)  Discard  those  edge  pixels  surrounding  all  regions  except  the  largest  region,  which  is 
assumed  to  be  the  target. 

(d)  Label  all  the  pixels  inside  the  one  remaining  region  as  target  pixels. 
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Figure  5.  Segmenting  a  Noisy  Image: 

a)  The  noisy  original  image  of  a  5-sided  polygon, 

b)  Result  of  thresholded  the  image  in  (a), 

c)  Fix-up  by  Algorithm  A  assuming  the  object  in  (b)  is  4-connected, 

d)  Fix-up  by  Algorithm  A  assuming  the  object  in  (b)  is  8 -connected, 

e)  Result  of  the  final  Baseline  Segmentation  Algorithm  on  the  noisy  image 
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If  Algorithm  A  is  followed  as  stated,  there  are  two  possible  results,  which  are  determined  by 
whether  the  object  is  assumed  to  be  defined  by  4-connectedness  or  8-connectedness.  (To 
understand  the  difference  between  8-connected  and  4-connected  regions,  see  the  Appendix). 
Figure  5c  shows  the  results  of  performing  the  above  algorithm  manually  assuming  that  the  target 
object  we  are  looking  for  is  defined  by  4-connectedness.  This  does  not  appear  quite  right  since 
there  are  still  some  pixels  which  we  would  consider  to  be  "background"  embedded  within  what 
appears  to  be  the  "target".  The  problem  is  that  in  the  process  of  finding  the  edges  of  an  object 
which  is  assumed  to  be  4-connected,  an  8-connected  background  is  generated.  Assuming  the 
target  to  be  8-connected  does  not  improve  the  situation  as  Figure  5d  shows.  Although  the  holes 
within  the  target  region  are  gone,  the  8-connected  target  assumption  attaches  too  many  pixels  tot  he 
target  which  in  reality  appear  to  be  barely  connected  to  the  real  target 

In  consideration  of  the  above  discussion,  we  now  define  a  segmentation  algorithm  which  appears 
to  overcome  the  stated  difficulties.  By  adding  one  additional  step  to  the  above  algorithm,  we  are 
able  to  segment  objects  so  that  both  the  object  and  the  background  appear  to  be  4-connected 
objects. 


Baseline-Segmentation  Algorithm 

1.  Threshold  the  image  at  a  value  midway  between  the  original  target  and  background 
intensity  values. 

2.  Fix-up  the  resulting  binarized  image  by: 

2.1  Examine  each  pixel  which  is  labeled  as  a  target  pixel.  If  it  is  not  4-connected  to 
another  target  pixel,  then  re-label  the  pixel  as  background. 

2.2  Detect  edge  pixels  of  all  4-connected  objects. 

2.3  Determine  the  size  of  each  4-connected  object  which  is  enclosed  by  the  edge 
pixels. 

2.4  Discard  those  edge  pixels  surrounding  all  objects  except  the  largest  one,  which 
is  assumed  to  be  the  target. 

2.5  Label  all  the  pixels  inside  the  one  remaining  object  as  target  pixels. 

Figure  5e  shows  the  result  of  applying  this  algorithm  to  the  noisy  image  of  Figure  5a.  Although 
the  software  implementation  of  this  algorithm  is  straightforward,  we  have  yet  written  the  code  to 
perform  it.  Therefore,  in  the  experiments  reported  on  below,  we  performed  this  algorithm 
manually. 

The  second  issue  which  must  be  resolved  is  the  fact  that  noise  introduces  randomness.  Since  each 
noise  realization  is  slightly  different,  the  exact  distortion  introduced  by  the  noise  differs  from  trial 
to  trial,  which  makes  the  MRP  seem  to  be  a  random  quantity.  What  is  desired  is  the  average  MRP, 
which  means  that  the  average  value  of  do2(n,I)  must  be  computed.  This  implies  a  Monte  Carlo 
collection  of  simulations.  However,  since  do2(n,I)  is  itself  computed  from  an  integral  over  the 
effects  of  the  noise  on  the  individual  pixels,  in  fact  only  very  few  Monte  Carlo  runs  need  to  be 
performed  to  get  an  accurate  estimate  of  the  mean  of  do2(n>I)- 
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4. 


Description  of  the  Performance  Modeling  Software 


In  this  phase  of  the  research  we  have  concentrated  on  developing  a  software  tool  for  the  analysis  of 
the  imaging  sensor  subsystem  only.  This  software  tool  is  described  in  this  section.  Future  work 
will  include  software  hooks  for  analyzing  the  algorithm  subsystem  as  well.  Plans  for  how  to 
accomplish  this  extension  are  given  in  the  section  of  this  report  entitled  "Feasibility  of  the  Method". 
All  the  software  was  developed  on  a  Macintosh  El  computer. 

4.1.  Control  Software  Environment 

Each  of  the  imaging  system  components  is  simulated  in  a  separate  FORTRAN  subroutine. 
Listings  of  the  source  code  for  these  subroutines  are  given  in  the  Appendix.  To  create  an  overall 
simulation  of  the  imaging  system  requires  that  each  subroutine  be  called  in  turn.  While  this  can 
obviously  be  done  from  a  FORTRAN  control  driver  routine,  we  have  taken  a  more  interactive 
approach  which  allows  us  to  stop  the  simulation  in  progress,  view  partial  results,  continue  the 
simulation,  etc.  In  this  approach,  a  commercial  image  processing  software  package,  called  IPLab, 
which  is  made  and  marketed  by  Signal  Analytics  is  used  to 

•  Control  the  simulation  of  the  imaging  system 

•  Obtain  parameter  inputs  from  the  user 

•  Control  the  display  of  image  data 

•  Maintain  data  files  associated  with  the  simulation 

•  Perform  the  shape  distortion  computations. 

The  imaging  system  modeling  subroutines  and  some  IPLab  control  functions  are  grouped  in  a 
sequence  called  a  Script  in  IPLab.  A  Script  is  essentially  a  mini-sequence  controller  which  is  easily 
created  and  edited  from  within  IPLab  and  it  may  be  stopped  at  any  time  to  view  partial  results.  A 
listing  of  the  commands  in  one  such  IPLab  Script  which  simply  makes  a  high  resolution  version  of 
the  data  is  given  below. 

IPLab  Command  Name  Comment 


Pause 

Open 

Select  All 
Copy 

Dispose  Window 
Show  Variables 
Select  All 
Paste 

UserProcedurel 

Pause 

New 

UserProcedure2 
Nonlinear  Filter 
Nonlinear  Filter 
Pause 

Select  All 


***Setup 

Get  input  parameters  from  vector 
Paste  into  IPLab  Variables 


Read  input  parameters  from  Variables 

***Make  the  test  pattern 

Put  it  in  a  new  window 

Fill  the  512x512  array 

Erode  to  smooth  rough  edges 

Erode  to  smooth  rough  edges 

*  * 'Multiply  by  MTFs 
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Transform 

UserProcedure3 

UserProcedure4 

Transform 

Change  Data  Type 

Rename  Window 

Change  Window 

Dispose 

Pause 

UserProcedure5 
Show  Display 
END 


:FFT  the  scene  data 
■.Apply  Optical  MTF  to  Magnitude 
: Apply  Detector  MTF  to  Magnitude 
: Inverse  FFT 

-.Make  it  Integer  data  type 
: Call  it  Data 

-.Dispose  of  imaginary  part 


FFT 

FFT 


n 


:  *** Apply  Sampling  and  Noise 
■.Sampling  and  noise 
•.Display  image 
■.Return  interactive  control 


The  commands  labeled  UserProcedurel  -  UserProcedure5  designate  FORTRAN  subroutines 
which  have  been  written  specifically  to  implement  portions  of  the  imaging  system  simulation. 

The  software  accepts  inputs  into  a  vector  which  can  be  saved  for  repeated  use.  The  input 
parameters  are  as  follows: 


nSides 

= 

Number  of  sides  in  the  polygonal  target 

tDiameter 

= 

Diameter  of  circular  target  (meters) 

tRange 

= 

Range  to  target  (meters) 

orient 

Rotation  angle  for  target  or  clutter 

TargOrClut 

= 

0  to  generate  a  target  shape 

1  to  generate  clutter  shape 

amplitude 

= 

Amplitude  of  random  variable  added  to 

polygonal  shape  to  make  clutter 

bandwidth 

— 

Bandwidth  of  random  variable  added  to 

polygonal  shape  to  make  clutter 

opticalFO 

= 

Optical  cutoff  freq  fo  =  optical  diameter/wavelength. 

IFOVdetx 

= 

detector  IFOV  in  x-direction  (in  mr) 

IFOVdety 

detector  IFOV  in  y-direction  (in  mr) 

rectOrHex 

= 

0  for  rectangular  sampling,  1  for  hexagonal  sampling 

SNR 

= 

RMS  signal  to  noise  ratio.Must  be  >  0. 

seed 

= 

For  random  number  generator 

4.2.  Imaging  System  Simulation 

Sensor  resolution  is  affected  by  image  blurring  (due  to  the  optics,  the  detector  size  and  shape,  and 
blur  due  to  motion  of  the  camera  or  objects  in  the  scene)  and  spatial  sampling.  There  are  two  types 
of  noise  introduced  by  the  sensor  system:  spatial,  which  can  be  seen  in  a  single  frame  of  image 
data,  and  temporal,  which  can  only  be  seen  frame  to  frame.  We  consider  only  single  frame 
processing,  so  temporal  noise  is  ignored  for  the  moment.  The  sum  of  the  various  independent 
noise  sources  in  a  single  image  frame  is  often  usefully  modeled  as  a  spatially  stationary  Gaussian 
random  process,  which  is  generally  characterized  by  its  variance  and  correlation  function,  or 
equivalently,  the  noise  power  spectrum.  Detector  non-uniformity  is  a  non- zero  mean  noise  source 
which  cannot  be  modeled  as  a  spatially  stationary  random  process,  so  it  is  usually  handled 
separately.  The  atmosphere  contributes  both  resolution  degradation,  which  is  similar  to  the  optical 
effects,  and  signal  attenuation,  which  lowers  signal  strength  and  hence  the  signal  to  noise  ratio. 
Distortion  at  the  output  of  the  detection  stage  is  naturally  represented  in  terms  of  deviations  from 
the  pixel  intensities  which  would  be  obtained  from  a  perfect  imaging  system. 
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The  following  system  components  have  been  simulated  in  the  current  version  of  our  performance 
modeling  software: 

•  System  inputs:  Generation  of  synthetic  test  patterns 

•  Optical  MTF 

•  Detector  MTF 

•  Sampling  due  to  the  detector  array  geometry 

•  Additive  noise 

The  model  formulations  for  each  of  these  components  is  given  next. 

4.2.1.  Test  Pattern  Generation 

The  test  patterns  are  generated  in  an  array  of  size  512x512  samples  of  integer  data  type.  There  is 
only  one  test  pattern  object  in  the  array,  and  it  is  centered  at  location  (256,256).  The  background  is 
taken  to  have  value  0  and  the  interior  of  the  target  (or  clutter)  object  is  filled  with  value  200.  All 
simulations  of  the  imaging  system  are  performed  on  this  array  or  the  Discrete  Fourier  Transform  of 
the  data  in  this  array. 

The  polar  coordinate  representation  formulas  given  in  the  section  above  on  The  Test  Pattern  Set  are 
used  to  define  the  boundaries  of  the  test  patterns 

p(9,°°)  =  r  (°°),  for  a  circle 

p(0,n)  =  r(n)/cos(  (8  mod  (2rc/n) )  -  2rc/2n  )  for  a  polygon  with  n  sides 

PcluuerCM)  -  p(9,n)  +  U (Q,a,b)  for  a  clutter  object 

where  the  random  function  U  is  obtained  by  Filtering  the  outputs  of  a  random  number  generator 
called  ranu 

U(0ic,a,&)  =  (l-&)*U(9k-  i ,a,b)  +  6*ranu(k) 

To  generate  the  test  patterns  the  angle  parameter  0  <  9  <  2n  is  sampled  into  1000  elementary  units 
9k  =27dc/1000,  k  =  0,1,..  .,999. 

The  radius  r  of  the  circle  is  taken  to  be 

r(oo)  =  180  for  the  circular  target. 

The  parameter  r  is  adjusted  for  each  of  the  other  target  test  patterns  so  that  the  average  of  the 
maximum  and  minimum  radii  over  the  target  is  equal  to  180.  This  requires  that 

r  (n)  =  1  +  l/cosCn/n)  for  a  polygon  with  n  sides 
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Diffraction  limited  circular  disk  optics  are  assumed.  The  MTF  is 
H(Q)  =  ~  {  cos -l(Q)  -  Q(1  -  Q2)l/2  } 
where  the  normalized  radial  frequency  Q  is  given  by 


(fx2  +  fv2)i/2 


(cycles/mr) 


a.  =  wavelength  (micrometers) 

fy  =  optical  f-number 

C  =  focal  length  of  the  optical  system  (micrometers) 

Notice  that  the  two-dimensional  MTF  is  used  in  the  Shape  Distortion  Analysis  software;  a  one¬ 
dimensional  approximation  is  not  required  as  it  is  in  the  MRT  analysis.  To  simplify  input,  the 
software  accepts  only  fq. 


Rectangular  shaped  detectors  are  assumed.  The  analog  MTF  of  such  a  detector  is 

o  f  x  _  sin(rcDxfx)  sinfaDyfy) 

Hanalog(tx.ty)  -  DxfxDyfy 

where  Dx  and  Dy  are  the  horizontal  and  vertical  dimensions  of  the  detector.  In  a  digital  computer 
simulation  where  analog  lengths  must  be  simulated  by  some  number  of  digital  samples,  the 
following  formula  gives  a  more  accurate  representation  of  the  desired  MTF 

it  ,c  f  ^  sinptNxfx)  sinfaNyfy) 

“digital  ITxdy)  -  Nxsin(fx)Nysin(fy) 

where  Nx  is  the  number  of  samples  in  the  simulation  required  to  represent  Dx,  and  similarly  for 
Ny.  The  inverse  DFT  of  Hdigitai  is  indeed  a  rectangular  pulse,  whereas  the  inverse  DFT  of  the 
Hanalog  demonstrates  undesired  oscillations.  H^gitai  is  used  in  the  software  simulation. 


The  performance  modeling  software  allows  for  two  different  types  of  sampling  imagers: 

•  Rectangular  detectors  centered  on  a  rectangular  lattice 

•  Rectangular  detectors  centered  on  a  hexagonal  lattice 
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The  difference  between  these  two  types  of  detectors  is  shown  in  Figure  6.  The  hexagonal  detector 
array  has  alternate  rows  displaced  by  one-half  pixel  width.  This  detector  array  geometry  was 
chosen  over  the  ideal  hexagonal  close-packed  detector  array  geometry  (in  which  each  detector 
element  is  a  true  hexagon)  due  to  its  simplicity  of  simulation.  However,  this  is  a  reasonable  first 
approximation  to  hexagonal  close-packed  detector  elements.  Furthermore,  this  detector  array 
geometry  is  also  of  interest  because  the  technology  for  manufacturing  detector  arrays  forces  one  to 
consider  rectangular  detector  elements  before  considering  the  more  complicated  hexagonal  detector 
elements. 


a)  Rectangular  Lattice 


Figure  6.  Geometry  of  Rectangular  and  Hexagonal  Lattices  of  Rectangular  Detectors 

Our  objective  in  simulating  the  degrading  effects  of  an  imaging  system  is  to  obtain  an  image  of  a 
target  whose  shape  can  be  compared  to  the  original.  Since  sampling  reduces  the  size  of  an  object, 
the  sampled  image  itself  cannot  be  directly  compared  to  the  original  without  expanding  it  to  the 
same  size  as  the  original.  This  re-sizing  implies  some  son  of  interpolation  must  be  done.  We  use 
zeroth  order  interpolation,  i.e.  simple  pixel  replication,  for  both  the  rectangular  and  hexagonal 
sampling  arrays. 

The  additive  noise  is  modeled  as  white  (i.e.  spatially  independent)  and  Gaussian  distributed.  It  is 
added  to  each  pixel  as  the  sample  is  formed. 

4.3.  Shape  Distortion  Computation 

The  Normalized  Distortion  Measure  fM(n,I),  as  defined  in  Figure  4,  requires  performing  the  image 
segmentation,  taking  the  absolute  value  of  the  difference  between  certain  images,  summing  the 
pixel  values  in  the  absolute  difference  images,  and  computing  a  ratio.  All  these  operations  except 
the  segmentation  step  are  performed  in  an  IPLab  Script.  The  segmentation  required  in  the 
computation  of  :M(n,I)  is  accomplished  in  this  version  of  the  software  via  simple  thresholding: 


rWnfi  -  f  1  if  data(i  j)  -  tar8et  vaIue 

data(i,j)  -  otherwise 

When  noise  is  present  the  algorithm  described  in  Section  3.5  for  "cleaning"  the  thresholded  image 
is  performed  manually. 


5.  Experimental  Results 

In  order  to  test  the  validity  of  the  Shape  Distortion  Analyzer  we  must  compare  the  performance  as 
predicted  by  it  to  the  actual  performance  of  some  target  recognition  subsystem.  Since  the  handiest 
target  recognition  system  is  human  vision,  we  decided  to  compare  the  computed  ranked 
performance  of  several  subject  imaging  systems  with  the  ranked  performance  of  the  same 
simulated  imaging  systems  as  perceived  by  humans.  In  order  to  make  the  human  recognizer  more 
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like  an  automatic  target  recognizer,  we  only  present  the  segmented  images  u  the  human.  This 
eliminates  the  ability  of  the  human  visual  system  to  extract  additional  information  from  the 
grayscales  images  in  any  nonlinear  (read:  "Not  currently  understood")  way  in  order  to  resolve 
shapes.  It  must  also  be  noted  that  no  specific  attempt  has  been  made  to  design  an  accurate  psycho¬ 
visual  testing  environment.  In  fact  one  may  expect  biases  in  this  initial  set  of  experiments. 
However,  the  results  at  least  give  a  preliminary  comparison  of  the  use  of  the  MRP  vs.  human 
recognition. 

In  general,  we  use  the  following  experimental  procedure: 

(i)  The  portion  of  the  imaging  system  which  is  to  be  studied  is  selected.  This  may  include  any 
combination  of:  (a)  optical  MTF;  (b)  detector  MTF;  (c)  sampling;  (d)  additive  noise. 

(ii)  An  IPLab  script  is  constructed  which  includes  those  selected  components  of  the  optical  system 
in  the  portion  of  the  Script  which  simulates  the  imaging  system. 

(iii)  The  rest  of  the  IPLab  Script  is  setup  to  compute  the  Normalized  Distortion  Function  M(n,I) 
and  loop  over  n,  the  number  of  sides  in  the  test  polygons. 

(iv)  As  the  image  of  each  polygonal  test  target  is  segmented  for  computing  n,I)  it  is  also  printed 
on  a  laser  printer. 

(v)  The  value  of  n  at  which  !M(n,I)  crosses  unity  is  noted  as  the  Maximum  Resolvable  Polygon. 

(vi)  The  human  subject  is  shown  the  same  series  of  images  and  in  each  case  is  asked  to  decide 
whether  the  image  looks  more  like  it  came  from  a  circle  or  a  regular  polygon  of  the  given  number 
of  sides  The  value  of  n  at  which  this  choice  becomes  ambiguous  is  noted  as  Nhuman.  the  50% 
recognition  point  for  humans. 

Only  some  of  the  front  end  imaging  system  components  have  been  studied.  Satisfactory  results 
from  these  experiments  would  justify  extending  the  analysis  to  include  other  components  of  the 
imaging  system,  such  as  atmospheric  effects  and  the  algorithmic  sections  of  the  system  itself. 

Two  different  studies  were  performed: 

•  Hexagonal  sampling  versus  rectangular  sampling 

•  The  effect  of  noise 


Certain  nominal  parameter  values  were  used  in  the  experiments.  The  values  of  the  parameters 
marked  with  an  asterisk  (*)  below  are  taken  from  the  test  case  which  appears  in  the  NVL  Static 
Performance  Model  Report.  Other  parameters  represent  our  best  judgement  regarding  useful 
ranges  of  values. 


nSides 

tDiameter 

tRange 

orient 

TargOrClut 

amplitude 

bandwidth 

*opticalF0 

*IFOVdetx 


3  to  10 

10  meters  (roughly  the  size  of  a  tank) 

2000  meters 
0 

0  (only  target  shapes  were  used  in  the  experiments  reported  on  here) 
0 
0 

10000  (corresponds  to  optical  diameter=4  in.,  wavelength  =  10pm) 
.25  mr 
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*EFOVdety  = 

.25  mr  (nominal  for  rectangular  sampling  lattice) 

rectOrHex 

0  for  rectangular  sampling,  1  for  hexagonal  sampling 

*SNR 

1000  down  to  2.5  (2.5  is  the  NVLSPM  test  case  value) 

seed  = 

0 

1 

vs  Rectangular  Sampling 

First  we  give  a  word  of  caution  about  the  results  presented  here  on  comparing  hexagonal  versus 
rectangular  sampling  lattice  detector  geometries.  This  study  only  analyzes  shape  distortion  by  the 
imaging  sensor.  No  account  is  taken  of  the  relative  merits  of  hexagonal  versus  rectangular  lattices 
in  algorithm  performance.  The  results  here  show  there  is  little  difference  in  the  shape  distortion 
between  the  two  types  of  sensors.  This  means  that  the  quality  of  the  image  data  passed  to  the 
algorithm  subsystem  is  virtually  identical  for  either  sensor.  If  this  result  is  borne  out  by  further 
experimentation,  it  means  that  imaging  system  designers  would  be  free  to  choose  the  lattice 
configuration  which  provides  the  best  algorithm  performance.  For  example,  there  is  significant 
evidence  that  hexagonal  sampling  yields  images  which  are  "more  recognizable"  by  algorithms 
based  on  mathematical  morphology.3  With  the  growing  interest  in  and  success  of  pattern 
recognition  algorithms  based  on  mathematical  morphology,  researchers  in  that  field  should  be 
happy  to  find  that  the  shape  data  they  could  get  from  a  hexagonal  sampling  lattice  is  just  as  good  as 
that  which  may  be  obtained  from  a  rectangular  sampling  lattice. 

We  have  already  discussed  the  use  of  rectangular  sampling  elements  for  both  the  rectangular  and 
hexagonal  sampling  arrays  in  this  simulation.  One  must  also  consider  the  inter-sample  spacing. 
For  this  experiment,  the  nominal  parameter  values  were  used  for  the  rectangular  sampling  lattice, 
so  the  detector  IFOV  is  .25  mr  square.  However,  for  the  hexagonal  lattice,  refer  to  Figure  7.  In  a 
true  hexagonal  sampling  lattice,  the  center-to-center  distances  between  adjacent  detectors  is  the 
same,  so  the  spacing  between  rows  of  detectors  is  less  than  the  horizontal  sample  spacing.  We 
want  to  know  whether  this  reduced  vertical  sample  spacing  helps  the  imager  performance,  so  we 
have  compared  three  kinds  of  samplers: 

•  Rectangular  lattice  with  .25  mr  square  EFOV  (Rect  Imager) 

•  Hexagonal  lattice  with  .25  mr  square  IFOV  (Hex-Square  Imager) 

V3 

•  Hexagonal  lattice  with  horizontal  EFOV  =  .25  mr  and  vertical  IFOV  =^-  (.25)  =  .22  mr 

(Hex-Nonsquare) 

In  this  experiment,  the  detectors  are  rectangular  and  contiguous  in  each  of  the  sampling  arrays. 


3  J.  Serra,  Image  Analysis  and  Mathematical  Morphology,  Academic  Press,  1982.  See  Chapter  VI  on  Digital 
Morphology  for  a  discussion  of  the  relative  merits  of  rectangular  versus  hexagonal  sampling  with  respect  to 
morphological  algorithms. 
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n  n) 


Figure  7.  Detector  Spacing  in  a  Hexagonal  Lattice 


n 

Figure  8.  Normalized  Distortion  Measure  for  Three  Imagers 
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The  computed  Normalized  Distortion  Measure  !M{n,I)  is  plotted  in  Figure  8  for  each  of  these  three 
imagers.  The  MRP  and  Nhuman  are  summarized  in  Table  1  below.  The  imaged  polygons  with 
Nhuman  and  Nhuman  +1  sides  for  each  imager  are  shown  in  the  Figure  9.  Although  by  human 
recognition,  the  Hex-Nonsquare  lattice  performs  slightly  better  than  the  other  two  imagers,  this 
experiment  suggests  that  hexagonal  lattice  samplers  and  rectangular  lattice  samplers  degrade  the 
image  data  fairly  equally  from  the  viewpoint  of  an  automatic  target  recognizer.  From  visual 
inspection,  the  hexagonal  lattice  samplers  can  follow  edges  along  certain  orientations  better  than 
rectangular  samplers.  The  notable  exception  to  this  is  vertically  oriented  edges,  which  are  poorly 
tracked  by  the  hexagonal  samplers  (For  example  see  the  right  edges  of  the  9-sided  polygons  in 
Figures  9c  and  9e).  Each  of  imagers  produces  artifacts;  however,  humans  appear  to  be  better  able 
to  reject  the  boundary  irregularities  produced  by  the  hexagonal  samplers  than  a  Matched  Filter  can. 

Table  1.  Comparing  Sampling  Geometries 


Imager 

MftP 

Nhuman 

Rect 

8.2 

8- 

Hex-Square 

8.4 

9- 

Hex-Nonsquare 

8.2 

9+ 

Notice  that  performance  based  on  MRP  does  not  really  improve  even  when  the  smaller  detector 
elements  are  used  for  the  hexagonal  sampler.  This  result  seems  to  contradict  the  theoretical  result 
that  hexagonal  close  packed  detector  elements  should  sample  the  image  more  efficiently. 
However,  keep  in  mind  that  the  detector  elements  here  were  rectangular.  The  results  from  this 
experiment  say  only  that  you  should  not  expect  any  performance  gain  from  sampling  on  hexagonal 
centers  if  you  take  the  easy  way  out  and  make  your  detectors  rectangular.  It  is  still  uncertain  what 
would  happen  if  you  use  hexagonal  detectors. 
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f)  Hex-Nonsquare  lattice,  10-sided  polygon. 

Figure  9.  The  Segmented  Images  for  the  Experiment  Comparing  Rectangular  and  Hexagonal 

Sampling 
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5.2.  The  Effect  of  Noise 

The  Normalized  Distortion  Function  94{n,\)  was  computed  for  signal  to  noise  ratios  of  2.5  and  4.0 
and  the  results  are  plotted  in  Figure  10  together  with  the  results  for  an  essentially  infinite  SNR. 


Figure  10.  Normalized  Distortion  as  a  Function  of  n  and  SNR 

To  compare  the  influence  of  noise  on  the  measure  5Vf(n,I)  to  human  performance,  we  have  taken  a 
slightly  approach  than  in  the  previous  experiment.  We  fixed  the  value  of  n,  the  number  of  sides  in 
the  regular  polygon,  and  varied  the  signal  to  noise  ratio  to  (i)  the  point  at  which  5W(n,I)  =  1  and  (ii) 
the  point  at  which  a  human  barely  can  discern  the  object  from  a  Circle.  The  results  are  summarized 
in  Table  2  below. 


Table  2.  SNR  Required  for  Recognition 


n 

SNR  at 

5Vf(n,I)  «  1 

SNR  for  human 
recognition 

4 

1.25 

1.25 

5 

2.5 

2.5 

6 

4.0 

4.0 

7 

5.0 

4.5 
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The  hand  segmented  images  for  each  of  the  human  recognition  cases  are  shown  in  Figure  1 1.  The 
required  SNR  as  predicted  by  the  MRP  is  in  quite  close  agreement  with  the  observed  performance 
of  a  human.  Notice  that  the  required  SNR  depends  on  the  task.  In  performing  the  task  of 
distinguishing  between  a  square  and  a  circle,  both  the  human  and  the  predicted  automatic  target 
recognizer  can  tolerate  a  fairly  low  signal  to  noise  ratio.  In  fact  the  sqaure  shape  is  quite  distorted, 
but  it  can  still  be  said  with  some  confidence  that  it  could  not  have  come  from  a  Circle  target  shape. 
However,  since  a  hexagon  is  much  closer  to  a  circle  to  begin  with,  much  less  noise  can  be  tolerated 
by  both  the  human  and  the  predicted  automatic  target  recognizer  for  them  to  discern  the  object  from 
a  Circle. 

It  should  also  be  noticed  that  the  noisy  segmented  shapes  can  be  non-cor.vex.  This  is  one  of  the 
primary  difficulties  in  using  a  polar  coordinate  representation  of  the  image  shapes.  Since  the  polar 
coordinate  shape  representation  could  only  be  used  to  represent  convex  shapes. 


40 


42 


d)  7-sided  polygon  at  SNR  =  4.5. 


Figure  11.  The  Segmented  Images  Used  in  the  Experiment  to  Determine  the  Effects  of  Noise. 
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6.  Summary  and  Estimate  of  Technical  Feasibility 


Our  theoretical  analysis  of  the  MRP  indicates  that  it  estimates  the  target  shape  conditions  at  which  a 
target  recognition  system  will  produce  a  50%  error  rate.  This  can  be  viewed  as  an  upper  bound  on 
the  performance  of  an  ATR  system.  Although  performance  results  are  not  derived  analytically,  the 
simulations  analysis  do  produce  empirical  relationships  between  performance  and  sensor  system 
design  parameters.  The  simulation  experiments  reported  in  the  previous  section  validate  that  the 
MRP  can  be  used  as  a  reliable  measure  of  the  relative  performance  ability  of  various  pattern 
recognition  systems  when  compared  to  human  visual  pattern  recognition. 

The  MRP  relies  on  a  computer  simulation  of  the  imaging  system.  Typically,  most  imaging  system 
components  are  described  via  mathematical/computer  models,  so  this  use  of  a  computer  simulation 
to  analyze  system  performance  is  often  preferred  to  a  purely  analytical  approach.  While  such  a 
computer  simulation  requires  more  extensive  computer  power  than  the  computation  of  an  analytical 
formula  like  the  MRT,  the  MRP  may  still  be  considered  relatively  easy  to  compute.  All  software 
simulations  and  experiments  reported  on  here  were  performed  on  a  personal  computer. 

One  significant  piece  of  the  software  required  to  automatically  perform  MRP  calculations  has  been 
omitted  during  this  phase  of  the  research:  the  automatic  segmentation  of  noisy  images.  Although 
this  is  an  active  field  of  research,  a  baseline  algorithm  is  required  for  the  computation  of  the  MRP. 
We  have  defined  such  a  baseline  segmentation  algorithm  which  we  have  applied  manually  to 
segment  noisy  images.  However  this  algorithm  appears  to  have  a  straightforward  software 
implementation,  therefore  it  poses  no  problem  to  the  ultimate  use  of  the  MRP. 

The  MRP  analysis  could  be  applied  to  trade-off  studies  on  essentially  any  design  parameter  of  the 
imaging  system.  The  basic  performance  modeling  technique  and  software  which  has  been 
developed  here  can  be  used  to  perform  sensor  system  trade-off  studies  on  resolution  versus 
sensitivity,  detector  shape,  and  sampling  array  geometry.  In  order  to  perform  trade-off  studies  on 
sensor  parameters  which  relate  to  temporal  effects  such  as  frame  rate  (or  dwell  time),  temporal 
noise  (e.g.  1/f  noise),  and  relative  motion  between  the  target  and  sensor  only  the  soft’  /are 
simulation  of  these  effects  on  image  pixel  intensities  needs  to  be  developed. 

The  computed  MRP  depends  on  the  use  of  a  new  set  of  synthetic  test  patterns  which  we  have 
proposed  to  replace  the  bar  pattern  (which  is  used  to  analyze  the  performance  of  man-in-the-loop 
systems).  It  still  must  be  determined  whether  predicting  system  performance  based  this  new  test 
pattern  set  gives  a  valid  prediction  of  the  system  performance  in  real  tactical  situations.  This  may 
be  the  biggest  challenge  to  the  use  of  the  MRP  as  a  performance  measure.  However  we  believe 
that  the  new  test  pattern  set  has  several  advantages.  It  has  many  of  the  characteristics  of  real 
targets.  It  is  characterized  by  a  single  parameter,  the  number  of  sides  in  the  polygons.  Clutter-like 
objects  are  also  derived  from  this  test  pattern  set.  And  we  have  defined  a  logical  relationship 
between  the  choice  of  test  patterns  and  the  tasks  of  Detection,  Recognition,  and  Identification. 

The  MRP  could  be  extended  by  relating  feature  computation  algorithms  to  shape  distortion.  Most 
feature  computations  are  based  on  a  generic  shape  model.  For  example  if  a  target  is  modeled  as  a 
rectangle  or  ellipse  it  can  be  described  by  the  single  feature  "length  to  width  ratio."  Thus  given  a 
set  of  feature  values,  one  could  construct  a  representative  shape  based  on  the  underlying  target 
model  and  having  the  given  feature  values.  This  shape  can  then  be  compared  to  the  original  target 
to  determine  distortion.  Analyses  of  this  form  may  lead  us  to  alternative  features  which  better 
describe  target  shapes. 

Another  issue  in  ATR  systems  which  may  be  addressed  is  how  to  use  multi-spectral  data.  There  is 
already  significant  research  being  done  on  how  to  use  the  spectral  differences  between  targets  and 
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clutter  for  ATR.  Another  approach  would  be  to  use  multi-spectral  data  to  improve  image  shape 
detection.  This  may  require  registered  images  from  different  (displaced)  sensors  or  one  may 
consider  a  single  sensor  with  different  detectors  for  different  wavelengths  (like  the  human  eye.).  In 
the  first  case  one  must  determine  how  accurately  the  images  from  the  different  sensors  must  be 
registered.  In  the  second  case  there  are  issues  relating  to  the  relative  size,  number  and  location  of 
the  detectors  for  different  wavelengths  on  the  focal  plane. 
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7.  Appendix 

7.1.  Derivation  of  the  Polar  Coordinate  Representation  of  a  General  Polygon, 


First  consider  the  triangle 

rr/cos(9  -  2tc/6)  for  0  <  0  <  2k/ 3 

p(0,3)  =  u/cos(0  -  2n/6  -  2k/3)  for  2n/3  <  0  <  4n/3 

lr/cos(0  -  2n/6  -  4?r/3)  for  Ak/3  <  0  <  6rc/ 3 

r  determines  the  minimum  radius  of  the  triangle.  The  first  equation  can  be  obtained  from  the 
rectangular  coordinates  for  a  vertical  line  which  is  a  distance  r  from  the  origin  at  its  closest  point: 

x  =  r 

In  polar  coordinates  this  becomes 

cos(0)  =  r,  or  p  =r/cos(9) 

Each  side  of  the  triangle  subtends  an  arc  of  2n/3  radians.  The  arc  subtended  by  this  first  side  is 
centered  on  0  =  0.  The  other  sides  can  be  obtained  from  the  first  by  rotation  through  2n/3  and  4it/3 
radians  to  give  sides  2  and  3  respectively.  With  this  in  mind  then,  the  formula  for  the  regular 
polygon  with  n  sides  can  be  obtained  in  polar  coordinates. 

p(0,n)  =  r/cos(0  -  2;t/2n  -  k  2rc/n) 

for  k  2rc/n  <  0  <  (k  +  1)  2;t/n,  k=0,l,...,n-l 

r  determines  the  minimum  radius  of  the  polygon,  n  is  the  number  of  sides  in  the  polygon,  and  k  is 
an  index  for  which  side  is  being  drawn,  0  corresponding  to  the  first  side,  n-1  corresponding  to  the 
last  side. 
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7,2,  Foiu^Cannected  Regions  Versus  8-Connected  Regions 


Two  pixels  in  an  8-connected  region  are  considered  adjacent  if  they  touch  at  either  a  pixel  edge  or  a 
pixel  comer.  The  five  dark  pixels  in  Figure  A- la  are  pan  of  a  single  8-connected  region.  Any  two 
pixels  in  an  4-connected  region  are  considered  adjacent  only  if  they  touch  at  a  pi vcl  edge. 
Therefore  the  five  dark  pixels  in  Figure  A-la  form  five  different  regions  ’ f  ’-connectedness  is 
assumed.  The  five  pixels  in  Figure  9b  are  part  of  one  region  in  either  4-connected  or  8-connected 
space.  Note  that  if  the  target  region  is  defined  by  8-connectedness,  then  the  background  must  be 
considered  to  be  4-connected,  and,  conversely,  4-connected  targets  can  only  live  in  8-connected 
backgrounds. 


a)  The  dark  pixels  are  pari  of  a  single 
8-connected  region  or  form  5  different 
4-connected  regions. 


b)  The  dark  pixels  are  part  of  a  single 
8-connected  region  or  4-connected  region. 


Figure  A- 1.  Comparing  4-connected  and  8-connected  regions 
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7.3.  Software  Listings 


A  FORTRAN  listing  is  attached.  The  first  subroutine,  called  FUserProcedure,  is  a  control 
subroutine  which  is  called  from  IPLab  with  an  index  to  tell  it  which  of  the  following  subroutines 
the  user  has  selected  from  the  IPLab  menus.  A  summary  of  these  subroutines  follows: 


Readlnputs: 

CreateData: 

OpticalMTF: 

DetectorMTF: 

Sampler: 

Segmenter: 

GetPolarShape: 

PlotPolarShape: 


Reads  input  parameters  into  local  commons 

Fills  an  512x512  integer  image  array  with  a  test  pattern 

Multiplies  the  image  FFT  data  passed  to  it  by  the  MTF  of  the  optics. 
The  2-D  FFT  is  accomplished  in  IPLab  before  calling  this  routine. 

Multiplies  the  image  FFT  data  passed  to  it  by  the  MTF  of  the  optics 

Samples  the  image  data  on  a  rectangular  or  hexagonal  lattice 

Thresholds  the  image  data 

Computes  polar  coord,  representation  of  the  segmented  image 

Places  the  polar  coord,  shape  data  into  a  vector  which  can  be  plotted 
from  within  IPLab. 


The  computation  of  5W(n)  is  accomplished  inside  IPLab  itself. 
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HD 4  0  :  Opt  imai  Imager  :  Code  :  FUserCcde  .  t .  § 


r  age 


’  M  I  n  1  ines .  t 

’.IS  FUserCcdeSegment 


I NTEGER* 2  FUNCTION  FUue rProcedu re  ( Index, 

1  windowKind, 

2  dataType, 

3  width,  height, 

4  dataO,  variables, 

5  ROILeft, ROITop, ROIRight , ROIBottom, 

6  cTable, 

'  imageC:  ^ct, 

3  theMocu 

c  windowKind 
c  0:  image; 

c  1:  vector; 

c  dataType 

c  C:  3YTE  image  or  vector; 
c  1;  SHORT  INTEGER  image  or  vector; 
c  2:  LGNGINT  image  or  vector; 
c  3;  FLOATING  POINT  image  or  vector; 
c  theMode 

c  0;  this  routine  is  being  called  interactively 
u  1:  this  routine  is  being  called  from  a  script 

c  include  1  Types. f' 

STRUCTURE  /Point/ 

UNION 


INTECER‘2  v 
INTEGER-2  h 
END  MAP 
MAP 

INTEGER-2  vh(0:l) 

END  MAP 
END  UNION 
END  STRUCTURE 

STRUCTURE  /Rect/ 

UNION 

MAP 

INTEGER-2  top,  left,  bottom,  right 
END  MAP 
MAP 

RECORD  /Point/  topLeft, botRight 
END  MAP 
END  UNION 
END  STRUCTURE 

STRUCTURE  /Region/ 

INTEGER-2  rgnSize 
record  /Rect/  rgnBBox 
END  STRUCTURE 

STRUCTURE  /RgnPtr/ 

POINTER  /Region/  RgnP 
END  STRUCTURE 

STRUCTURE  /RgnHandle/ 

POINTER  /RgnPtr/  RgnH 
END  STRUCTURE 


IMPLICIT  NONE 

INTEGER- 2  index, windowKind, dataType, theMode 
INTEGER-4  width, height 
INTEGER-2  '  taO (width, height) 

INTEGER-4  -riables (256) 

INTEGER-4  ROILeft , ROITop, ROIRight , ROIBottom 
INTEGER- 2  cTable ( 4 , 256 ) 

RECORD  /RgnHandle/  imageObject 


INCLUDE 


1  Commons . f ' 


INTEGER-2  Readlnputs, CreateData, OpticalMTF, DetectorMTF 
INTEGER- 2  Sampler, Segmenter, GetPolar Shape, PlotPolar Shape 


goto (100, 200, 300,400, 500,600,700,800)  index 
FUserProcedure  =  1 
return 


100  continue 

FUserProcedure  =  Readlnputs  (windowKind, dataType, width, height,  dataO, variables) 
return 

200  continue 

FUserProcedure  =  CreateData (windowKind, dataType, width, height , dataO , variables) 
return 

300  continue 

FUserProcedure  *  OpticalMTF (windowKind, dataType, width, height , dataO , variables ) 
return 
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400  continue 

F UserProcedure 
return 

500  continue 

FUserPrccedure 

return 

600  continue 

FUserProceaure 

return 

700  continue 

FUserProcedure 

return 

800  continue 

FUserProceaure 

return 

900  continue 

FUserProcedure 
call  Exit 
return 
end 


DetectorMTF (windowKlnd, dataType, width, height, dataO, variables) 
Sampler (windowKlnd, dataType .width, height , dataO , variables ) 
Segmenter (windowKlnd, dataType, width, height , dataO , variables) 
GetPolarShape (windowKlnd,  dataType .width, height , dataO , variables ) 
PlotPolarShape (windowKlnd, dataType, width, height , dataO , variables) 


CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC 

Integer *2  function  Readlnputs (windowKlnd,  dataType,  width,  height,  dataO,  variables) 


IMPLICIT 

INTEGER*2 

INTEGERS 

REALM 

INTEGERM 


NONE 

windowKlnd, dataType 
width, height 
dataO (width, height) 
variables (256) 


REAL*  4  IFOVdetx, IFOVdety 

INCLUDE  'Commons. f* 


r.Polnts 

= 

1024 

radius 

= 

180 

nSides 

= 

variables(0  + 

1! 

tDlameter 

= 

variables (1  + 

1) 

tRange 

= 

variables (2  » 

1) 

orient 

= 

abs (variables 

(3  +  1)  ) 

TargOrClut 

.= 

variables (4  + 

1) 

amplitude 

variables (5  + 

11/100.0 

bandwidth 

= 

variables (6  + 

D/100.0 

optlcalFO 

= 

variables (7  + 

1) 

IFOVdetx 

= 

variables(8  + 

n/ioo.o 

IFOVdety 

= 

variables (9  + 

n/ioo.o 

rectOrHex 

= 

variables ( 10 

+  i) 

SNR 

=: 

variables (11 

+  n/ioo.o 

seed 

= 

variables ( 12 

+  i) 

(Number  of  points  around  a  circluar  target 
!Radlus  of  standard  circular  target 
(Number  of  sides  in  the  polygonal  target 
(Diameter  of  circular  target  (meters) 
(Range  to  target  (meters) 

(Rotation  angle  for  target  or  clutter 
!  =  0  to  generate  a  target  shape 
!  =  1  to  generate  clutter  shape 
(Amplitude  of  random  variable  added  to 
(polygonal  shape  to  make  clutter 
(Bandwidth  of  random  variable  added  to 
(polygonal  shape  to  make  clutter 
(Optical  cutoff  freq  fO  = 

(optical  diameter/wavelength  (•  10000). 
(detector  IFOV  In  x-directlon  (In  mr) 
(detector  IFOV  In  y-dlrectlon  (in  mr) 

!  «  0  for  rectangular  sampling 
!  =  1  for  hexagonal  sampling 
(RMS  signal  to  noise  ratio. Must  be  >  0. 
(For  random  number  generator 


radPerPixel  =  ( tDlameter/ ( 2 . 0  *  radius) ) /tRange 
dxSample  =  ( IFOVdetx* 1 . Oe-3 )/ radPerPixel 

if (2* (dxSample/2)  .eq.  dxSample)  dxSample  =  dxSample  +  I  (make  sure  its  odd 
dysample  =  ( IFOVdety* 1 . Oe-3) / radPerPixel 

If  ( 2 *  (dySample/ 2 )  .eq.  dysample)  dySample  =  dySample  +■  1  (make  sure  its  odd 


targValue  =  200 
Readlnputs  ■  0 
return 
end 


ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
integer*2  function  CreateData (windowKlnd, dataType, width, height, dataO, variables) 

c  draw  the  data  or  clutter  as  an  image  In  rectangular  coordinates. 


IMPLICIT 

NONE 

INTEGERS 

f  or  cedD  Intension 

PARAMETER 

( forcedDlmension  =  512) 

INTEGER*2 

windowKlnd, dataType 

INTEGERM 

width, height 

INTEGER* 2 

dataO (width, height) 

INTEGER* 4 

variables (256) 

INTEGER* 4 

loopx, loopy, x Index, y Index, index, xValue, yVa lue ,  x2 , y2 ,  fd2 

INTEGER* 2 

anglelndex 

REALM 

rho, theta 

REALM 

maxRho.mlnRho 

REALM 

distance, angle 

REALM 

pi, twoPI 

REALM 

Distortion, thetaPrime 

REALM 

ranU 

INCLUDE  ' Commons. f 
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if  (  (dataType  ..-.e.  I)  .or.  ( wrndowKlnd.r.e . 0 )  )  th^n  'Only  draw  Into  integer  image  Window 

cal.  3ys3eep(5) 

CreateData  =  I 
return 
end  if 

i  f  (  (width .  r.e .  forceaDimensi.cn)  .or.  ( height . ne . f orcedDimension ) )  then 
ca ij.  5ysSeep(5/ 

CreateData  =  I 
return 
end  if 

ol  -  3.14159265 

twoPI  =  6.2931853 

fd2  =£orcedDimension/2 

(First  make  the  snape  data 

Distortion  =  0 
maxRho  =  0 
mlnRho  -  1.0e32 

do  25  loopx  =  l,nPoints 

index  =  modlloopx  +  orient  -  l,nPolnts)  »  1 

iflnSldes  .eq.  0)  then 

shapeData ( index)  =  radius 
else  iflnSldes  .eq.  3)  then 

thetaPrime  =  mod ( loopx, nPoints/3)  *  twoPI/nPolnts  -  twoPI/ (2*3) 

shapeData ( index)  =  2.0*radius/(  (1.0  +  1 . 0/cos ( twoPI/ (2  *  3) ))* cos ( thetaPrime)  ) 
else  iflnSldes  .eq.  4)  then 

thetaPrime  »  mod  ( loopx,  nPoints/4 )  *  twoP  I /r.Points  -  twoPI/ (2*4) 

shapeData (index)  =  2.0*radius/(  (1.0  +  1 .0/cos (twoPI/ (2*4 ))) *cos (thetaPrime)  ) 
else  iflnSldes  .eq.  5)  then 

thetaPrime  =  mod ( loopx, nPolnts/ 5)  *  twoPI/r.Polnts  -  twoPI/ (2*5) 
shapeData ( index)  =  2.0*radius/(  (1.0  +  1 .0/cos (twoPI/ (2*5) )) *cos (thetaPrime)  ) 
else  iflnSldes  .eq.  6)  then 

thetaPrime  =  mod ( loopx, nPolnts / 6)  *  twoPI/nPoints  -  twoPI/ (2*6) 
shapeData ( index)  «  2.0*radlus/(  <1.0  *  1 . 0/cos ( twoPI / (2 * 6) ))* cos ( thetaPrime)  ) 
else 

thetaPrime  =  mod ( loopx, nPolnts/nSides )  *  twoPI/nPoints  -  twoPI/ (2*nSldes) 
shapeData ( index)  =  2.0*radlus/(  (1.0  +  1 . 0/cos (twoPI/ (2*nSides) )) *cos (thetaPrime)  ) 
end  if 

if (TargOrClut  .eq.  1)  then 

Distortion  »  ( 1-bandwldth) "Distortion  +  bandwidth’ ( ranU (seed)  -  .5) 
shapeData ( Index)  =  shapeData ( Index)  +  radlus*amplitude*Dlstortlon 
end  if 

maxRho  =  max (maxRho, shapeData ( index) ) 
minRho  »  min (mlnRho, shapeData (index) ) 

25  continue 


(fill  space  inside  rho(theta)  with  targValue 

do  110  loopx  =  1, width 
x Index  *  loopx 
xValue  =  xlndex  -  fd2 
x2  =  xValue**2 
do  110  loopy  =  1, height 

y Index  =  1  *•  height  -  loopy 
■/Value  =  loopy  -  fd2 
y2  »  yValue**2 

distance  =  sqrt (float (x2  +  y2 ) ) 
if  (distance  .gt.  maxRho)  then 
dataO  (xlndex, y Index)  =  0 
e  Ise 

if (distance  .It.  minRho)  then 

dataO (Xlndex, ylndex)  =  targValue 
else 

angle  =  atan2 (float (yValue) , float (xValue) ) 
angle  »  nPolnts* (angle  +  pi) /twoPI 
anglelndex  =  min (nPolnts,  max ( 1 ,  nlnt (angle) ) ) 
if(  distance  .le.  shapeData (anglelndex)  )  then 
dataO (xlndex, ylndex)  =  targValue 
else 

dataO (xlndex, ylndex)  =  0 
end  if 
end  if 
end  if 

110  continue 

CreateData  ■  0 
return 
end 

ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
integer *2  function  OptlcalMTF (wlndowKind, dataType, width, height, dataO, variables) 

c  Multiply  the  Magnitude  FFT  passed  in  dataO  by  the  MFT  of  the  optics 

c  dataO  must  be  REAL*4  data  and  the  FFT  is  assumed  to  have  DC  centered  at  ( l+width/2, l+wldth/2) 


IMPLICIT  NONE 


INTEGER* 2  wlndowKind, dataType 
INTEGER*4  width, height 
REAL*4  dataO (width, height) 
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INTEGERS  variables  (256) 

INTEGER *2  1 oopx, loopy, center  Index 

REAL*4  lx, fy, frequency 

REAL  *  4  r.T ax,  opt  refactor,  Hopt ,  omega,  twoOverPi 

INCLUDE  1  Commons. £' 

if ((dataType  .r.e.  3)  .or.  ( windowKind.  ne .  0) )  then  :c.nly  REAL  *  4  image  data 

call  Sys8eep(5) 

OpticalMTF  =  1 
return 
end  if 

(Multiply  by  optical  and  detector  MFTs 

centerlndex  =  wldth/2  +  1 

twoOverPi  =  2.0/PI 

fmax  =  1 . 0/ (2  .  Q*  radPerPixel) 

opticFactor  =  fmax/ (float (width/2)  *  opticaiFO) 

do  50  loopy  =  1, height 
do  50  loopx  =  1, width 

fx  =  loopx  -  centerlndex 
frequency  =  sqrt(fx*fx  »  fy’fy) 
omega  =  optlcFactor’f requency 

if (omega. It . 1 .0)  then  (optical  MTF 

Hopt  =  twoOverPi  *  (acos  (omega)  -  cmega’sqrtd  -  omega  "omega ) ) 
else 

Hopt  -  0 
end  If 

dataO  ( loopx, loopy)  =  Hopt  *  dataO (loopx, loopy) 

50  continue 

OpticalMTF  =  0 
return 
end 

ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
integer "2  function  DetectorMTF (windowKind, da taType, width, height, da taO, variables) 

c  Multiply  the  Magnitude  FFT  passed  In  dataO  by  the  MFT  of  the  detector 

c  dataO  must  be  REAL *4  data  and  the  FFT  is  assumed  to  have  DC  centered  at  ( 1 +width/2, 1 +wldth/2) 

IMPLICIT  NONE 

INTEGER*2  windowKind, dataType 
INTEGER’ 4  width, height 

REAL *4  dataO (width, height) 

INTEGER*4  variables  (256) 

INT£GER*2  loopx, loopy , centerlndex 
REAL ’4  fx, fy, frequency 

REAL*4  detFactor, omegax, omegay, Hdetx, Hdety 

REAL  *  4  temp 

INCLUDE  ' Commons. f' 

if ((dataType  .ne.  3)  .or.  (windowKind. ne . 0) )  then  (Only  R£AL*4  image  data 

call  SysBeep(5) 

DetectorMTF  =  1 
return 
end  if 

(Multiply  by  detector  MFT 

centerlndex  =  wldth/2  *  1 

detFactor  =  P I / f loat ( width) 

do  50  loopy  =  1, height 

(y-dimension  detector  MFT 

fy  =  loopy  -  centerlndex 
omegay  »  detFactor’fy 
temp  =  sin (omegay) 
if (temp.ne.0)  then 

Hdety  =  sin (dySample’omegay) / (dySample’temp) 
else 

Hdety  *  1 
end  if 

do  50  loopx  =  l.wldtn 

(x-dlmension  detector  MFT 

omegax  =  detFactor *fx 
temp  =  sin (omegax) 
if  (temp. ne. 0)  then 

Hdetx  =  sin  (dxSample’omegax) / (dxSample’temp) 
else 

Hdetx  »  1 
end  if 

dataO ( loopx, loopy)  =  Hdety  *  Hdetx  *  dataO ( loopx, loopy ) 

50  continue 

DetectorMTF  *  0 
return 
end 

ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
integer*2  function  Sampler (windowKind, dataType, width, height, dataO, variables) 
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Image  c ; Cede  :  F'Jse rCoae  .  f  .  § 


IMPLICIT 


NONE 


INTEGER*  2 

,v  l  r.dowK  L r.o,  Type 

INTEGER  *4 

*  iduh,  ne  ianu 

INTEGER*  2 

:acaG  t  wianr.,  neignt) 

INTEGER*4 

vjr iables  *256) 

:nteger*2 

loopx, loopy, xlndex,  y 

REAL  *  4 

r.oiseFacucr 

REAL *4 

RanG 

INCLUDE  1 C J 

rrjnons .  i  * 

INTEGER* 2 

Z  a  rnp  i  e  i  r.  de  x  Re  c  t 

50 


75 


i f ( IdataType  .r.e.  1)  .or.  (wlndowKlnd.ne.O)  )  then  (Only  sample  integer  Image  data 

call  SysBeep(i) 

Sampler  =  : 
return 
end  If 

(sample  Image  ana  add  p.clse 

nciseractor  -  f loat ( targValue ) /SNR 

! Rectangular  array 

1  f  (  rector. Hex .  eq.  0 )  then 
do  50  1 oopx  =  1, width 

xlndex  =  Sample  I ndexRect ( loopx, dxSampie) 
do  50  loopy  =  1, height 

■/Index  =  SamplelndexRect  (loopy,  dySamplel 
1  f((  x  Index .  r.e .  loopx)  .or.  (ylndex  .ne.  loopy)  )  then 
dataO  (loopx, loopy)  =  0 
el.se 

aataO  ( loopx,  loopy)  =  dataO ( loopx, loopy)  *  nint  (r.oiseFactcr*rang  (seed)  ! 
end  if 
continue 

(Reconstruction  to  original  size 

do  75  loopx  =  1, width 

xinaex  -  Sample IndexRect ( loopx, dxSampie) 
do  75  loopy  =  l.heignt 

ylndex  =  SamplelndexRect ( loopy, dySample) 
dataO ( loopx, loopy)  =  dataO (xlndex, ylndex) 
continue 


100 


175 


else  (Hexagonal  array 

do  100  loopx  =  1, width 
do  100  loopy  =  1, height 

call  SamplelndexHex ( loopx, loopy, xlndex, ylndex, dxSampie, dySamp.e) 

If  (  (xlndex  .ne .  loopx)  .or.  ( y  Index .  r.e  .  loopy )  )  then 
dataO ( loopx, loopy)  =  0 
else 

dataO  ( loopx, loopy)  =  dataO ( loopx, loopy)  *  nine (nolseFactor* rang (seed) ) 
end  1  f 
continue 

(Reconstruction  to  original  size 

do  175  loopx  =  1, width 
do  175  loopy  =  1, height 

call  SamplelndexHex (loopx,  loopy , xlndex ,  ylndex,  dxSampie, dySample) 
dataO  (loopx, loopy)  ■  dataO (xlndex, ylndex) 
continue 
end  If 


Sampler  =  0 
return 
end 


ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
subroutine  SamplelndexHex IxCoord,  yCoord, xlndex, ylndex,  dxSampie, dySample) 

IMPLICIT  NONE 

integer  *  2  xCoord, yCoord, xlndex, ylndex, dxSampie , dySample 

lnteger’2  ds2 


ylndex  »  in lnt ( f loat ( yCoord  -  1! /float (dySample) ) 
if (mod (ylndex, 2 ) ,eq. 0 )  then 
ds2  *  dxSampie/ 2  *  l 

xlndex  =  dxSampie  *  lnint ( f loat (xCoord  -  ds2) /float (dxSampie) ) 
else 

xlndex  -  dxSampie  *  lnint ( f loat (xCoord  -  1) /float (dxSampie) )  + 
end  1  f 

ylndex  =*  dySampie  *  ylndex  ♦  1 
return 
end 


*  ds2 
1 


ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
lnteger*2  function  SamplelndexRect (coord,  dSample) 

IMPLICIT  NONE 
integer*2  coord, dSample 

SamplelndexRect  »  dSample  *  nlnt (float (coord  -  1 ) /float (dSample) )  +  1 

return 

end 


ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
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lnteger*2  function  Segmer.ter  (wlndowKlnd,  dataType,  width,  hoi ght,  data 0 ,  varlaoies  j 
' ' SetC  usinglncludes  =  false 
Include  'Types.!1 
Include  1  QuickDraw . f 1 


c  Segment  image  data. 


IMPLICIT  NONE 


INTEGER" 2 
INTEGER* 4 
INTEGER*2 
INTEGER*4 


wlndowKlnd,  dataType 
width, height 
dataO (width,  height) 
variables (256) 


INTEGER*2  loopx, ioopy,  threshold, gotAnObject 
RECORD  /RgnHa.ndle/  wnole Image, tempOb ject , blgObject 
INTEGER*2  left, top, right, bottom  ! local  varlaoies 

RECORD  /Point/  myPolnt 

INCLUDE  ' Commons. f' 


threshold  =  targValue/2 
do  100  loopy  -  l,heignt 
do  10  0  loopx  =  ’..width 

1 f  (dataO ( loopx, ioopy )  . gt . threshold)  then 

dataO ( loopx, ioopy)  =  targValue 
else 

dataO ( loopx, loopy)  =  0 
end  if 


for  the  region  bounding  rectangie 


first  threshold 
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1000  Cegmenter  =  C 
return 


end 


cccccccccccc  rcccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
Integer *2  function  GetPo la r Shape (wlndowKlnd, dataType, width, height, dataO, variables) 

c  Convert  image  shape  to  vector  using  polar  coordinates. 


IMPLICIT  NONE 


INTEGER* 2  forcedDlm.enslon,  fd2 
PARAMETER  ( f orcedDlmens Ion  =  512) 


INTEGER*2 
INTEGER* 4 
INTEGER*  2 
INTEGERS 


wlndowKlnd, dataType 
width, height 
dataO (width, height) 
variables (256) 


INTEG£R*2  loopTheta, loopRho, maxLoopRho, xlndex, ylndex 


REAL  *4 
REAL  *  4 
REAL *4 
AEAL*4 


theta, deltaTheta, cosTheta, sinTheta 
rho, rhoMax 

x,  y 

pi , twoP I 


INCLUDE  'Commons. f' 


1  f ( (dataType . ne . 1 )  .or.  (wlndowKlnd . ne . 0 ) )  then  (Only  into  Integer  image  Window 

call  SysBeep(5) 

GetPola rShape  =  1 
return 
end  if 

1 f ( (width . ne . forcedDimenslon)  .or.  (height .ne . forcedDlmension) )  then 
call  SysBeep(5) 

GetPolarShape  »  1 
return 
end  If 


pi  -  3.14159265 

twoPI  =  6.2831853 

deltaTheta  =  twoPI / £ loat (nPolnts) 

fd2  =  f  orcedDim.enslon/2 

rhoMax  -  sqrt (2 . 0 ) *fd2 

(loop  on  theta  Index 

do  110  loopTheta  =  1, nPolnts 

theta  =  (loopTheta  -  1 ) ‘deltaTheta 
cosTheta  =  cos (theta) 
sinTheta  =■  sln(theta) 

(loop  that  direction  to  find  edge 

do  50  loopRho  =  1, rhoMax 

x  »  cosTheta* ( loopRho  -  1) 

y  »  sinTheta* (loopRho  -  I) 

xlndex  -  nint(x)  +  fd2 
ylndex  =  fd2  -  nint(y) 

If ( (xlndex. le . 1 )  .or.  (xlndex. ge . forcedDlmension) )  goto  75 
If  (  (xlndex. le . 1 )  .or.  (xlndex . ge . forcedDimenslon) )  goto  75 
if  (dataO (xlndex, ylndex) . It . targValue/2)  goto  75 
continue 


50 
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75  sr.apeData  ( ioopTheta)  =  sqrt  ( x *  x  ♦  y*y) 

110  continue 

Get.?oIa  reshape  =  7 

return 

ena 

ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
Integer *2  function  PlotPciarsnape ( windcwKir.d, dataType, width, height, aataC , var iaoles) 

c  Transfer  data  to  the  vector  m  dataO. 

IMPLICIT  NONE 

INTEGER*  2  wmdowKinc,  cat  a  Type 

INTEGER* 4  width, helgnt 

REAL *4  dataO (width, height ) 

INTEGER *4  var tables i 256) 

INTEGER*2  loop 

INCLUDE  '  Corrcnons  .  f  ' 

If  ( (dataType. ne.  3)  .or.  (wlndcwKlr.d.  ne.  1 )  )  then  !Only  into  floating  vector  Window 

call  SvsBeep(5) 

PlotPoiarShape  =  1 
return 
end  If 

If  (  (width .  it  .r.PolntsM  then 
call  SysBeep<5> 

PlotPoiarShape  =  I 
return 
end  If 

do  110  loop  =  1 ,  .".Points 

dataO  ( loop,  1 )  =  s.napeData  ( loop) 

110  continue 

PlotPoiarShape  =  0 

return 

end 

ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
real*4  function  RanU(seed) 
c 

c  returns  a  uniformly  distributed  random  variable  between  0.0  and  1.0 
ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
real*8  seed,c,a,b 

cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
c  These  are  the  parameters  used  by  VAX11/780  VMS  t=2**32  so  the  period  of 
c  this  sequence  should  be  2**32. 

c  An  alternative  value  for  a  is  1664525  as  given  in  Knuth.  It  scores  better 
c  on  the  spectral  test  than  a=69069. 
t=4294967296.0d0 
a=69Q69 .0d0 

seed=dmod (a*seed  +  1.0d0,t) 

ranu=seed/ t 

return 

end 


ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
real*4  function  RanG(seed) 
c 

c  compute  a  gaussian  distributed  random  variable  (NOTE:  seed  is  do  le 
c  precision) 
c  by  m.mort 

ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
neai*3  seed 

real*4  ul,u2 

ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
ul  =  RanU(seed) 
u2  =  RanU ( seed) 
if(ul.ne.  0.0)  then 

RanG  =  sqrt (-2 . O'alog (ul) ) *cos (6.283185307*u2) 
else 

RanG  =  sqrt (73.0) *cos ( 6 . 28 31 85307*u2 ) 
end  if 
return 
end 


